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The NASA STI Program 
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in Profile 


Since its founding, NASA has been dedicated to ensuring U.S. leadership in aeronautics 
and space science. The NASA Scientific and Technical Information (STI) Program plays 
an important part in helping NASA maintain its leadership role. 

The NASA STI Program provides access to the NASA STI Database, the largest collection 
of aeronautical and space science STI in the world. The Program is also NASA’s institutional 
mechanism for disseminating the results of its research and development activities. 

A number of specialized services help round out the Program’s diverse offerings, including 
creating custom thesauri, translating material to or from 34 foreign languages, building 
customized databases, organizing and publishing research results. 

For more information about the NASA STI Program, you can: 
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• Phone the NASA Access Help Desk at (301) 621-0390 

• Fax your question to NASA Access Help Desk at (301) 621-0134 

• Send us your question via the Internet to help@sti.nasa.gov 

• Write to: 

NASA Access Help Desk 
NASA Center for AeroSpace Information 
800 Elkridge Landing Road 
Linthicum Heights, MD 21090-2934 
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INTRODUCTION 
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The Workshop on Fuzzy Control Systems and Space Station Applications was held on 
November 14 and 15, 1990 in room 209A of the McDonnell Douglas Space Systems 
Company (MDSSC) Space Station Building 17 in Huntington Beach, California. The 
workshop was co-sponsored by MDSSC-SSD and NASA Ames Research Center. The 
participants included representatives from academia, industry and government. 


These proceedings present the material discussed in an order which closely approximates 
the actual sequence of the workshop. In addition, these proceedings contain papers by Dr. 
Bart Kosko on Fuzzy Logic and concluding remarks from Mark Gersh, Bob Brown, 
Dennis Lawler, Bob Lea and Hamid Berenji. 


This document is organized in the following order 

1. Biographies of the fuzzy logic control panel; 

2. Opening remarks from Dave Wensley; 

3. Presentations by Marie Gersh, Masald Togai, Michio Sugeno, Jack Aldridge, Hamid 

Berenji and Xiwen Ma; 

4. Papers on Fuzzy Logic theory by Bart Kosko; 

5. All MDSSC-SSD presentations including question and answer sessions; and 

6. Concluding remarks. 
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Workshop on Fuzzy Control Systems 
and Space Station Applications 

Biographical Information 


Hamid R. Berenji, Ph.D., received 
his B.S. degree from the University 
of Science and Technology, Iran and 
M.S. and Ph.D. degrees from the 
University of Southern California in 
1980 and 1986 in Systems 
Engineering. From 1984 to 1986, he 
was an instructor at University of 
Southern California, Los Angeles. 
Since 1986, he has worked in the 
Artificial Intelligence Research 
Branch of NASA Ames Research 
Center in Moffett Reid, California. 
He is currently a senior research 
scientist with Sterling Federal 
Systems and a principal investigator 
of the research project on intelligent 
control. He is a member of the 
Operation Research Society of 
America (ORSA), Operation 
Research Honor Society (Omega 
Rho), American Association for 
Artificial Intelligence (AAAI), and 
Institute of Electrical and Electronic 
Engineers (IEEE). He is a program 
committee member of several 
conferences such as the 1991 IEEE 
International Symposium on 
Intelligent Control and is the 
chairman and the organizer of the 
intelligent control session at the 1990 
Control and Decision Conference in 
Hawaii. His current research is 
focused on intelligent control as it 
relates to neural networks, 
approximate reasoning and fuzzy 
control, and uncertainty management 
in Al. 

Bart Kosko, Ph.D., is an Assistant 
Professor, of Electrical Engineering 
at the University of Southern 
California. He is best known for his 
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fundamental contributions to the field 
of Fuzzy Estimation Theory. He is 
Managing Editor of the Springer* 
Verlag monograph series. Lecture 
Notes in Neural Computing, and is 
Associate Editor of Neural Networks, 
IEEE Transactions on Neural 
Networks, Journal of Mathematical 
Biology, and Lecture Notes in 
Biomathematics. 

A much sought after lecturer, Dr. 
Kosko is an elected governor of the 
International Neural Network Society 
and a USC Shell Oil Faculty Fellow. 
He was program co-chairman of the 
Summer 1990 International Joint 
Conference on Neural Networks and 
Program Chairman of the 1990 
International Fuzzy Logic and Neural 
Networks Conference in lizuka, 
Japan. He was Program Chairman 
of the 1988 IEEE International 
Conference on Neural Networks 
(ICNN-88) and Program and 
Organizing Chairman of the first 
IEEE ICNN-87. 

Dr. Kosko received his master's 
degree in applied mathematics from 
the University of California, San 
Diego and his Ph.D. from the 
University of California, Irvine. 

Dennis Lawler received his B.S. 
degree in Mathematical Physics from 
State University of New York in 
1980, B.S. degree in Computer 
Science at the University of Houston 
and is presently pursuing an 
advanced degree in Mathematics. 
Mr. Lawler's work experience in the 
area of Advanced Automation began 
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at McDonnell Douglas Corporation 
where he was a major contributor to 
the Space Station Freedom 
advanced automation concepts. His 
speciality is model based reasoning 
and as Functional Area Manager for 
Advanced Automation he has been 
instrumental in the development of 
key advanced automation 
applications including the Thermal 
Advanced Automation Project, 
Failure Environment Analysis Tool, 
Automated Network Monitoring, Fault 
Analysis Propulsion System and the 
development of Advanced 
Automation Methodology for the 
Space Station. 

Robert Lea, Ph.D. received his B.S. 
and M.S. degrees in Mathematics 
from Louisiana State University in 
1960 and 1962 respectively, and his 
Ph.D. from the University of Houston 
in 1972. He joined NASA/JSC in 
1962 and has contributed to all of the 
major space programs. His 
association with fuzzy logic began in 
1985. During this time he has 
authored and co-authored over 30 
papers in this field. He was 
instrumental in organizing the first 
and second International Workshops 
on Neural Networks, and Fuzzy 
Logic held at the JSC in 1988 and 
1990 and the joint video 
demonstration sessions between 
Kyushu Institute and JSC, as part of 
the IFSA Workshop on Fuzzy Logic 
and Neural Networks held in 1990. 
He frequently participates in 
technical conferences and 
symposiums as an invited speaker or 
organizer of special sessions. Dr. 
Lea’s specific interests have recently 
been in the development and 
application of new technology such 
as fuzzy logic, neural networks, and 
Dempster Shafer theory. 
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Michio Sugono, Ph.D. is a professor 
in the Department of Systems 
Sciences at the Tokyo Institute of 
Technology. He has authored more 
than 50 papers and several books. 
His award winning book on Fuzzy 
Control was a best seller in Japan. 
He is an advisor to the Laboratory for 
International Fuzzy Engineering 
Research. He is an advisor to the 
Science and Technology Agency 
under the Office of the Prime 
Minister. His current work includes 
the development of the fuzzy control 
systems for an unmanned helicopter. 

Masaki Togai, Ph.D. received his 
M.S. and Ph.D. degrees in electrical 
engineering in 1977 and 1982, 
respectively, from Duke University. 
He is president and chief executive 
officer of Togai InfraLogic, Inc. Dr. 
Togai has spent the last 10 years 
leading fuzzy logic development 
groups at Duke University, AT&T Bell 
Laboratories, and Rockwell 
International. He is best known in 
the industry for developing the 
world's first fuzzy microchip for real- 
time approximate reasoning. He is a 
member of the board of directors of 
the North American Fuzzy 
Information Processing Society 
(NAFIPS), a member of the 
American Association of Artificial 
Intelligence, IEEE, International 
Fuzzy Systems Association (IFSA), 
and Sigma XL In addition, Dr. Togai 
is the editor-in-chief of the Japan 
Artificial Intelligence Newsletter; and 
is an associate editor for the 
Information Sciences, and the 
Journal of Approximate Reasoning. 
He is an author of two books: 
"Intelligent Robotic Systems", and 
"Approximate Reasoning in Expert 
Systems". He has authored and 
coauthored more that 30 papers. 
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L A. Zadeh, Ph.D., received his 
B.S.E.E. from the University of 
Teheran, Iran, in 1942; M.S.E.E. 
from the Massachusetts Institute of 
Technology (MIT), Cambridge, 
Massachusetts, in 1946; and Ph.D. 
from Columbia University, New York, 
New York, in 1949. He has been a 
professor of electrical engineering 
and computer sciences at the 
University of California, Berkeley, 
California, since 1959. Dr. Zadeh 
was an instructor in electrical 
engineering at Columbia University 
from 1946 to 1950, assistant 
professor from 1950 to 1953, 
associate professor from 1953 to 
1957, and professor from 1957 to 
1959. He has been a member of the 
Institute for Advanced Study, 
Princeton, New Jersey, since 1956; 
was a visiting professor of electrical 
engineering at MIT in 1962 and 
1968; was a visiting scientist at the 
IBM Research Laboratory in San 
Jose, California, in 1968, 1973, and 
1977; and was a visiting scholar at 
the Artificial Intelligence Center, SRI 
International, in Menlo Park, 
California, in 1981. 

Wei Xu, received his B.S. in 
Management Sciences in 1983 and 
his M.S. in Statistics in 1985, from 
Beijing University. From 1987 to 
1988 he was involved in research 
and development work on Fuzzy 
theoiy and applications. In 1988 Mr. 
Xu formed APT Instruments in 
Japan, where the first programmable 
fuzzy controller was developed. APT 
moved its operations to the United 
States in 1989 and went on to 
develop the first multi-tasking fuzzy 
programmable controller. Mr. Xu is a 
reviewer of "Fuzzy Sets and 
Systems". 
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OPENING REMARKS - Dave Wensley 


Dave Wensley, Vice President - Deputy General Manager Strategic Development for McDonnell 
Douglas Space Systems Company-Space Station Division (MDSSC-SSD) welcomed the 
participants of the Workshop on Fuzzy Control Systems and Space Station Applications with 
introductory remarks expressing hopes for a successful workshop. Mr Wensley emphasized that 
McDonnell Douglas is committed to the utilization of advanced technology on the Space Statipn 
Freedom Program (SSFP). , 

Mr. Wensley first discussed the background of the SSFP's status and development environment, 
including the current budget climate and the technical development . He expressed high 
expectations for the workshop since it provided an excellent forum for the tec hn ical interchange of 
ideas between the experts in the Fuzzy Logic field and engineers faced with the tasks of producing 
viable solutions for varied control applications operating within hostile environments. 
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FUZZY CONTROL/SPACE STATION 

AUTOMATION 

by 

Mark Gersh 
NASA Headquarters 


14 November 1990 
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Code MT Organization and Responsibilities 


Space Station Engineering Organization 


FREEDOM 




Space Station 
Engineering 
CodeMT 



• Advanced Systems Studies 

• Level I System Engineering and Analysis 
Support 



Configuration 
Management Office 
(MT-1) 


• Level I Configuration Management 
Support 

• MIC/Vils Support 


System Engineering b 

Systems b 

Advanced b 

and Analysis 1 

Development 1 

Programs 1 

(MTA) | 

(MTD) 1 

(MTTE) | 


• Systems Requirements Analysis and 
Definition 

• 8ystem Engineering 8tudies 

• Technical Assessment ot Change 
Requests 

• Independent Assessments of Ffighl 
and Ground 8ystems Performance 


• Requirements Implementation 
Oversight 

• Budget, Schedule, and Content 

• Oversight and Assessment 

• Development Status Reporting 

• Development Assessment 

• Level I TMI8 Support 


• Advanced Planning 

• Advanced Systems Studies 

• Technology Requirements Definition 
and Assessment 

• Advanced Development 

• Commercial Development 

• International Evolution 
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Code MT Staffing 
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Space Station 
Engineering 
CodeMT 


System Engineering 
and Analysis 
MTA 


Chief: Vacant (SE8) 

Secretary: Vacant 
LaRC Liaison (Detailed) 

Systems Eng Mgr: A. Edwards (acting) 

• Sys. Eng.: Vacant 

• Sys. Eng.: Vacant 

Systems Analysis Mgr: P. Neumann (acting) 

• Sys. Anal.: Vacant 

• Sys. Anal.: Vacant 


* Director: E.Huddna 

* Deputy Director. Vacant 

* Administrative Asst.: Vacant 

* Program Integration Analyst: Vacant 

* Secretary: K. Truman 


Configuration 
Management Office 
MT-1 

• Manager: R. Bobek 
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Chief: Vacant (SES) 

Deputy Chief: G. Swfetek (acting) 

Secretary: Vacant 
TMIS/DMS Mgr. OMSK* 

Systems Integration Mgr. Vacant 
Mechanical Systems Eng: Vacant 
Avionics Systems Eng: Vacant 
Ufa Support Systems Eng: Vacant • 

WP-1 Liaison: R. Marshal (Detalee-MSFC) < 
WP*2 Liaison: Vacant (DeiaBee-JSC) 

WP-3 Liaison: M. Sedtazek (Detalee-GSFC) 
WP-4 Liaison: Kely McLalin (Detaifee-LeRC) • 
International Liaison: Vacant 


Advanced 
Programs 
MTE 

Chief: Vacant (SES) 

Secretary: B. Seilert (acting) 

Advanced Planning Mgr: S. Cook (acting) 
External Programs Mgr: K.Barquinero 
(acting) 

- PoBcy Analyst: Vacant 

- Policy Analyst: Vacant (PMI) 

Adv. Studies Mgr: P.AhH 

SEI Accommodations Mgr: Vacant 

• Power/Propulsion Mgr: Vacant (CADP) 

- Advanced Life Support Mgr: Vacant (CADP) 
Adv. Development Mgr: 

A. Femquisl (Detaifee-Ames) 

• Autonomous Systems Eng: M. Gersh 

• Robotics Eng: M. Drews (Detaitee-JPL) 


Last Modified 10/1/00 
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Provide a 


permanently manned 


presence In space 
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Stimulate advanced technologies 


Promote international cooperation 


Encourage private sector participation and utilization 
Provide options for future endeavors in space 



SPACE STATION FREEDOM 
Evolution 


Freedom is a permanent facility: 

- Upgrades and configuration changes will take place 
on-orbit 


During the operational life of the Space Station: 

- National priorities will change 

- User needs and mission requirements will change 

• Technology will evolve and components will become 
obsolete 


SPACE STATION FREEDOM 
EVOLUTION FOR HUMAN EXPLORATION 
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Lunar Vahlcla Operations 


Assembly Complete 
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SPACE STATION FREEDOM 

Factors Pointing to 
Automation & Robotics (A&R] 


FREEDOM 


• Space Station has a 30 year operational life 

- Operations costs, reliability are important concerns 

- Incorporation of new technology essential 

• Crew is most scarce resource 

- Productivity is crucial in meeting assembly, user, and servicing 
requirements 

• Evolution mission scenarios are crew-intensive 

- Science missions will grow and increase demand for crew time 

- On-orbit assembly, checkout, launch of Lunar/Mars vehicles 



SPACE STATION FREEDOM 
The A&R Promise 




Increased Mission Safety, Reliability 
Manage system complexity 

Trend analysis, fault detection, isolation, and reconfiguration 
■ Reduce EVA required 


Increased Mission Productivity, Services 
- Reduce "housekeeping" overhead 
■ Reduce experiment overhead 


Increased Probability of Mission Success 

Re-planning for contingencies, reactive science 

Reduced Operations Costs 

Training, software maintenance, sustaining engineering 



n 







SPACE ST A TION FREEDOM 

Astronaut Office Inputs 
Concerning A&R 
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• Regarding Advanced Automation 

- Simpie, standardized human interface (idiot proof) 

- Provide flexible operations capability 

- User (versus technology developer) oriented 

- Develop and implement easier applications first 
Help the user do the job easier (don't make it harder) 
Include What If?" Capability (In-line simulation) 

- Backup mode of operation 

System must be able to explain conclusions and actions 

Automate tedious and repetitive tasks, time dependent tasks, 
calibration and alignment tasks, robotic set-up for EVA 
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SPACE STATION FREEDOM 

Astronaut Office Inputs 
Concerning A&R 



Applications supported by crew for improving productivity 

- Automated record keeping and documentation (100%) 

- Automated inventory management (96%) 

- Automated FDIR (93%) 

- Improved human-computer interfaces (92%) 

- Robotic construction (92%) 

- Exception reporting and alarm filtering (88%) 

- External camera and light pointing (87%) 

- Robotic external repairs (85%) 

- Automated trend analysis (incipijnt failure detect’on) (85%) 

- Checklist automation (85%) 
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SPACE STATION FREEDOM 

Astronaut Office inputs 
Concerning A& R 




• Applications supported by crew for improving productivity: 

- Systems Monitoring and Control (82%) 

- EVA retriever robotics (81 %) 

- Payload-specific automation (79%) 

- On-board training systems (72%) 

- Internal camera and lighting pointing (58%) 

- Speech Recognition (56%) 

- Speech Synthesis (54%) 

- On-board scheduling/re-scheduling capability (52%) 

- IVA rack robot (50%) 

- IVA housekeeping robot (46%) 
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Advanced 



Enhanced baseline Space Station Freedom capabilities 

- Improve productivity and reliability 

- Reduce operations costs 
Prevent technological obsolescence 

Enable Space Station Freedom evolution 


• Products 

"Engineering" fidelity demonstrations, evaluations 
Detailed requirements, performance specifications 
- Mature technology, tools, applications 




SPACE STATION FREEDOM 

Flight System Automation 
and Ground Operations Applications 
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Focused on Automated Status Monitoring, Fault Detection, 
Isolation, and Recovery (FDIR) using Knowledge-Based System 
(KBS) techniques 

Understand design accommodations ("hooks and scars") 

- Instrumentation, control redundancy, interfaces 
Identify KBS implementation issues 

- Integration with conventional techniques 

- Processing, data storage, communication requirements 

- Software development, testing, maintenance 

- Boundaries of KBS technology (performance, scale, 
brittleness) 

Applications under development for Thermal, Power, Life Support, 
Data Management, Mission Control 



SPACE STATION FREEDOM 

Transition Definition Program 
Advanced Development - FY 1 990 


FREEDOM 



• Flight Systems and Ground Operations Automation Tasks 

- Focused on automated status monitoring, fault detection, isolation, 
and recovery (FDIR) using Knowledge-Based System (KBS) 
techniques 

- FDIR KBS applications under development for the Thermal Control 
System, Power Management and Distribution/Control Systems, 
Environmental Control and Life Support System, Data Management 
System, Operations Management System, Mission Control Center 
(MCC), and the Space Station Control Center (SSCC) 

- MCC applications were jointly developed with OAST and OSF and 
have supported STS-26, STS-29, STS-30, STS-28, STS-34 and 
STS-32; all will be transitioned to SSCC 
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SPACE STATION FREEDOM 

Advanced Automation 
Software Tools 
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• Focused on providing programming tools to enable 
development of integrated KBS applications within the Software 
Support Environment (SSE) 

- KBS programming tools which produce Ada code are under 
development and evaluation 

• Develop and demonstrate advanced programming tools which 
reduce the cost of software development and maintenance for 
flight and ground systems 

- "Programmers Assistant" that uses KBS techniques to aid 
programmers in Ada software re-use under evaluation 

- Programming environment for Intelligent Computer-Aided 
Training (ICAT) applications under development 
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Some General Thoughts on 
Technology Transition 
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In an ideal world, technology transition happens when... 

- The user is interested and involved in application development 

- The application and technology are consistent with operations 
concepts, procedures, and doctrine 

- Implementation is compatible with existing hardware and 

software and isolated ("firewalled") during initial evaluation 
period 

“ "Success" metrics are defined early and guaranteed at some 
minimal level 

- "Bottoms up" and "top down" pressure is simultaneous and 
consistent 

- Post deployment "care and feeding" issues are addressed early 
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SPACE STATION FREEDOM 

Some General Thoughts on 
Technology Transition "O 


• It's not an ideal world... 

- Organizational structure creates, encourages insular and myopic 
view of technology insertion opportunities and operational realities 

- Ego and fear of the unknown tends to reinforce status quo 

- Personnel and financial resources are limiting factors 

- Risk and schedule pressure are harsh realities 
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FREEDOM 


Summary 



• Automation is a key element in meeting Space Station Freedom 
baseline and evolution requirements 

• Automation technology is sufficiently mature to warrant early use 
within the Program 

• Scope and pace of automation applications will be determined by: 

- Success of early testbed prototypes 

- Support and acceptance of managers and users 

- Consistent implementation methodology and tools 

• 'Technology transfer is a body contact sport." - John Muratore, JSC 

- People are a key factor in affecting or preventing technology 
transfer and utilization 
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Togai InfraLogic, Inc. 

ARTIFICIAL INTELLIGENCE ON A CHIP 


Fuzzy Logic 

Is Well Suited For Handling 
Non-Linear, Time-Varying, and/or Ill-Defined Problems 
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Togai InfraLogic, Inc. 

ARTIFICIAL INTELLIGENCE ON A CHIP 


Japanese Companies Employing Fuzzy 


Canon 

Casto 

Daldan 
Fuji Electric 

Hitachi 

Moclzumt 

Ishlda Instruments 

Leon Auto Machinery 

Nippon Steel 

Maruman 

Mycom 

Meklen-aha 

Minolta 

Mitsubishi Chemical 
Mitsubishi Electric 


SLR camera focusing 
Stepper control 
Clean room temp & 
humidity control 
Gas cooling plant 
Chemical mixer 
Waste burning plant 
Sendai Subway control 
Elevator control 
GaAs crystal growth 
Automatic measuring 
Food processing 
Iron mill control 
Golf club selection 
Robotic controllers 
Dredging control 
Machine control 
Camera focusing 
Cement kiln control 
Elevator control 
Plasma Etching 


p Mitsubishi Heavy 

P Matsushita (Panasonic) 

Nissan Motor Company 
P 

P Nuclear Power Corp 

P Omron 

P 
P 

P Ricoh * 

D 

p Sanyo 

P Seiko 

p Subaru 

p Toshiba 

D 

p Yamalchl Securities 

P Yokogawa Electric 

D 

P 

P 

p 


Alr-condHIonlng systems 
Temperature controllers 
Automatic transmission 
ABS braking system 
Nuclear power plant control 
Factory controllers 
Robotic controllers 
Camera stabilizers 
Camera focusing 
Voice Recognition 
Camera Iris control 
Design expert system 
Automatic transmission 
Elevator control 
Product design expert system 
Stock trading 

Digital measurement systems 


P • Production 
D * Development 


view07 


Ti'ooinjotiooooTiOOOTni 




/ 


SUITABL.E APPLICATION AREA 
OF FUZZY THEORY 


— 


SUITABLE PROBLEMS 

I “T \ 


Man-Machine 
Interface Problem 

Time-varying 

dynamlcs/non-llnear 

problem 

Classification 

problem 

Problems of 

•Difficult to express 

•Plant dynamics 

•Action to be taken 

conventional 

control objecithtes 

varys In time 

Is not clear 

approach 

numerlally 

•Plant is non-linear 

•Cannot describe 


•Evaluate the control 

t 

all solutions for 


result by human 

overshoot 

possible patterns 


feeling 

oscillatior 

t 

speed/hardware 

limitations 

Applications 

w 

Sendai subway 

Temperture control 
of A/C, plant, etc. 

— ^ 

Auto-Iris/auto-focus 

9 

Suspension control 
Crane control 

Position control of 
a hard-disk head 

Hand-written 
character recognition 

Automatic 


Automatic 

Auto-cruise 

transmission 


transmission 
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CHARACTERISTICS OF FUZZY CONTROL 


PARALLEL/DISTRIBUTED CONTROL 


PRODUCTION RULES (IF-THEN) 

- SIMPLE KNOWLEDGE REPRESENTATION 

- MIXED PREMISE EVALUATION 

- EXCEPTION HANDLING 

QUALITATIVE EXPRESSIONS 


IMPROVEMENT 


jN QUALITY & ROBUSTNESS 


TOGA! INFRALOGIC/ INC. • 

KYOTO- 1 
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Mitsubishi Heavy Air Conditioner 


April 1 988 First, Design 
Simulation by Summer 


Production October 1989 
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Mitsubishi Heavy Air Conditioner 

• • 

Room Heating and Cooling Times Reduced by 5X 
Temperature Stability Increased by 2X 
Overall Power Savings of 24% 

Reduced the Required Number of Sensors 
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ARTIFICIAL INTELLIQBNCB ON A 


FUZZY INVE 
AIR CONDITIC 


t I TEMP. ^ TEMP. ERROR 

l SENSOR J H TEMP. CHANGE 

/ 

• 50 RULES (HEATING&A/C) 
•'MAX-PRODUCT INFERENCINQ 

• DEFUZZIFICATION: 
CENTROID METHOD 
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Mitsubishi Air Conditioner 

30 r 0-C 
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Introduc on v 

Regular research of th« automation of train opara*t»n 
began*' in around 1960 in Japan, and various tarts with 
real cars wart jnducttd for confirming functions of basic 
eleman such s constant spatd automatic cprttion 
cr r , trai. automatic stop control at predetermined 
location, and train interval control 
In tha last half of tha 1960's, ATO dtvL s wera applitd 
to tht test cars for the Sl’nkanstn bulla train and tha 
monorail vehicles for the 1970 World l. , sition held 
in Osaka, Japan. 

* Starting from 1963. ATO devices for remote cental were 


adopted fas dim! hydraulic lo co mo ti ve s oper ate d In. steel 
works, and saving labor and securing safety wart realized. 

In the 1970's, the ATO devices wens used fai many sut> 
way cars and v chides of tut mated jftidemay transporta- 
tion systems, r d many fanprov mar ts were made. 

RectnJ;* research on application of fuzzy . jntgl to • 
automatic Optra i i *ubwry^ctrs was star... 4 . ^ venue 
service of th ' vty line of Sendai M midp I Transporta- • 
tion Bureau was started in July# 1W7, and smooth and 
accurate automatic operation has been realized by employ- 
ing ATO devices based on fuzzy control 


45 


PREDICTIVE FUZZY CONTROL 



POZZY CONTROL 
RULES 


OBJECTIVE 
DIFFERENCES 


CONTROL 

COMMAND 


ACTUAL 

STATE 


STATE & 

OBJECTIVES 

PREDICTION 


FUZZY 

INFERENCE 


PROCESS 


SENDAI SUBWAY CONTROLLER 


TOG AX INFRALOGIC, INC. 

KYOTO-5 
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The Sendai Subway System 


t 


Xd - 
N(t) 
x(t) 
Vt - 
v(t) 


Safety 


~f Comfort 
-> 


3 


Energy 

Saving 


Traceability 


i| Running Time 


Stop Gap 



CSC 

Control 


^TASC 


Control 


Npc: CSC control comma 
to be selected 


Choice of the 
Total Control 
Notch 


*PN 

*BN 


Np-f: TASC control comma 
to be selected 


Xt 
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The Sendai Subway System 


First Proposed to the Government 1978 

Granted Permission to Operate After: 

3,000 Empty Subway Runs 
300,000 Simulations 

Began Operation in 1986 

Hitachi Granted Contracts for Tokyo Subway 1991 
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The Sendai Subway System 

Performance Improvements 

Improvement in Stop Gap by 3X 
Reduction in Power Settings by 2X 
Overall Reduction in Power by 10% 




Speed 
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The Sendai Subway System 


Limited Speed 
Target Speed 


^) : Performance index 

f Running Time J 
(Energy Consumption) 


(Safety) 


Control Equipment 


Target 

Position 


„(stop Gap) 


Station 


7S" 

PS1 

CSC Position 
Marker 


Station 

TASC Position 
Marker 


Distance 


Outline of automatic train operation 
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The Sendai Subway System 


ATC Wayside System , 
(Automatic U- 

Train Control) * 


-A 


'Train detection W 
and Signaling 



ATS System 
(Automatic 
Train Supervision) 


Supervisory 

Command 



- 

Track Circuit 
Position Marker 



. . 

1 

Traction 

Controller 

Aiu onooard 
System 

/ 




Cab Signal 



ATC Onboard 
System 

«— I — 


/ 

\ 

Brake 

Controller j 


^1 


Distance Pulse^^-H'' 


u 

Tac 

ho 1 

I 

Generator 



Typical configuration of ATO 
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The Sendai Subway System 
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Table 1 Symbols 

t : time (sec) 

x ( t) : location of train (m) 

v(t) : velocity of train (km/h) 

N(t) : control command notch 

X(t) : target position of next station (m) 

Vt : target speed (km/h) 

Tt : predicted running time (sec) 

X<j : forward location where the maximum speed limit is lower (m) 

ts : time to reach X<j point (sec) 

X|c : ending location of coasting (m) 

Xz(v) : beginning point of TASC zone (m) 
tz s (Xz(v)-x(t))/v(t) : time to TASC zone (sec) 
tc : elapsed time from last notch change (sec) 

N c : degree of last changed notch 

Np : control command notch to be selected 

Vp(Np) : predicted speed when N p notch Is selected (km/h) 

v e : velocity allowance range (km/h) 

^p(Np) : predicted stop position if Np notch is selected (m) 

Xe : allowance of stop gap (m) 


view 02 
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The Sendai Subway System 



The Register 




Fig. 2 Outline of automatic train operation by fuzzy control 



Theory of Fuzrness & Fuzzy Cont ol 

The theory of fuzziness was first proposed in 1965 by 
professor LA. Zade'i of the University of California at 
Berkeley. 

The theory of ft zziness dcols with a sat with ambiguous 
boundary instead of ti ordinary sat In the conventional 
Boolean set com orising "0" and Ml a M t«e boundary of 
an individual set ran be cMarly 'is inguished, but the 
fuzzy set is characterized by the s t that the boundary 
between the inside and outside of th . set h not obvious. 

The fuzzy control is based on the fuzzy set t* eory which 
was developed for cetsrmlning the qutnth/ of subjective 
fuzziness of human being and for m*7ng obj nhre erahja- 
tion of the 'izJntss possible, ard thereby «"n InatJng 
fuzzy portions as m ch as possible. 

In the conventio ul automatic # operation syren, 
train operation is performed *y a control based or • ID 
Control (Proportional Integra, d «nd Differential Contro*) 
so that target speed partem ^,i termined for each operat- 
ing section can be follow . 1 1 this conventional auto- 
matic train operation, accur tt operation can be achieved 
in a manner of following the predetermined sp eed pattern. 
However, in actual practice, there arc many kinds of 
changes of running condi ions such as gradient etc. of 


track and the braking force of rolling stock. Therefore, 
to follow the target speed, it is necessary to sand ntnl 
commands frequently for acceleration and braka applica- 
tion. As a result, smooth operation is apt to become dif- 
ficult, and riding comfort is liktly to be degraded. More- 
over, an accuracy of train stopping at predetermined loca- 
tions of stations cannot be determined through the logic 
of the control system. Accordingly dispersion should be 
checked by computer simulation or tern using real art 
This kind of problem occurs because "he train operation 
characteristics as a controUe I system are not well adapted 
to its control system. The characteristics of running train 
vary complicated ly and norvJinearty in response to changes 
in the external situation. In the conventional control 
method, complicated controlled systems, were dealt with 
approximating then to simple linear models, and only 
the follow-up to predete mined s.jeed pattern was taken 
into account in the evaluation related to control. That is, 
the conventional control was unable to properly respond 
t J changes in the situation. 

T • th* other hand, in the fuzzy control, the results of 
certain runnin. operations being considered are predicted 
it advance as the same as actual decisions made by a 



Fig. 3 Comparison of the results between fuzzy control and PI D control 
(stop accuracy and number "f times control command changes) 
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The Sendai Subway System 



Stop-Gap and Power Settings 




■i Cities/ABC, Inc. Pubncjiu . 



ELECTRONICS REVIEW 


VOL 2, NO. 15/ SEPTEMBER, 1990 . V;: "... . , . $2:50 


Nissan Close To Introducing Fuzzy Logic 


Transmission Controller 


fcy ANDREA SAXE* 

S ooa— I# the next year or 
ao-Nktaa w tit run mH> 
lag cart programmed 
with a new, extra mart trmas- 
miuioa control, popularly 
known at fuzzy logic Specula- 
lion It that tofereace-besed con- 
trol lo«k wU debu t on Niasaa's 
300 ZK, the company*! premier 
performance car. and perhaps 
on its Inflnirt CM3 l u x ur y sedan. 

Industry Analyst Roger 
Stedak, San Joee, CA, reported 
guberu and Maada are wriowh 
punning the same mart control 
tech ni que. He predicted a two- 
to three-year tine frame for this 
to happen, at moat 
Like Nissan. Subaru will apply 
fairy logic so tnnxskiion c on- 
troL Maada la tasting It for appli- 
cation in codblon avoidance m- 
tons. la Mazda's case, Stedak 
ex pec ted a long lead lima, as 
Much as tea yean, since legal 
approvals for ks syatein wtt re- 
quire extensive testing. 

Hiroshi TakihashC research 
engineer at Nissan's Centra! En- 
gineering laboratories, Yokosu- 
ka. Japan, said Honda and Isuxu 
are working on fuzzy toglq for 
automotive electronic controls 
u welt. Engine control, with Its 
Please, tee FuKy Let*. P- 12 



re* 


CONCEPTUALLY SPEAWNO: The Mum AroX concept car he* a 
control schema tost could Incorporate fuzzy logic. aooo r dtog to 
Hiroshi Takahashl, a research engineer at Nbsan'a Central Engineer, 
tog Laboratories. Yokosuka, Japan 



COULD IT B£ THE REST? WM the transmission in Nkaan's 1991 300 
2X bo tholret production cor to bo o ontroOod by tuny togfc? 


i muSSaS 



WHAT A DOTERENCC: More sNfttng, tost co ntort Honda stocRnd 
shift achedulng and fcxnd that gears were «N*e d Imi -nen Ww 
kanenUseion wea conuoAad by fuzzy logic ratoer tonn a *e<JOon^ 
program. Thn comparison chart comes trom a paper (*9050*9) 
sented by Honda Research and Development Engineers Sakai, A/m, 
Hategawa. SakagucN and Krekl at the toternattonU Fade* •t'on of An- 
lomotke Engineering Societies to Turin, ttfy. In May. Cal r» Sccwtf 
ol Automotive Engineer s. Warrendak. PA * 1 2-77MH t . h* a ccoy. 


Committee OKs 

/.nnq/ IVHQ Fnnrlrnn 



Toyota JlR* n 
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Automatic Transmission 

Objectives: 

Smoother Ride 
Increased Fuel Savings 


Less Wear 
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Automatic Transmission 
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Automatic Transmission 
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Nissan Patents 

By ANGELA G. KING 

T ROY, Mich. - Nissan Motor Co. 
Ltd. has received U.S. patents 
on an anti-lock brake system 
and a transmission that incorporate 
"fuzzy logic" computer programming. 
Designed to automate human rea- 
soning, fuzzy logic programming offers 
various possible solutions, using grad- 
ed or qualified statements, to a prob- 
lem rather than the precise yes-or-no 
solution of strict logic widely used in 
the electronics industry, according to 
Lofti A. Zadeh, who first developed the 
concept of fuzzy reasoning in the mid- 
1960s. 

Mr. Zadeh is currently a Professor 
of Computer Science in the Electrical 
Engineering and Computer Science de- 
partment at the University of Califor- 
nia at Berkeley. 

A Nissan spokesmah said engineers 
are still developing the brake and 
transmissions systems, and no intro- 
duction dates have been set Nissan 
has developed a fuzzy logic program 
and is now looking to see if it can be 
applied to its patented transmission 
and brake system designs, he ex- 
plained. Funy logic programming, ac- 
cording to the company, would en- 
hance brake and transmission system 
performance with improved control 
flexibility. 

Nissan is developing an automatic 
transmission in which fuzzy logic com- 
puter programming is used to electron- 
ically shift gears in a manner similar 
to a driver who weighs different fac- 
tors to manually shift gears. 

WITH A CONVENTIONAL automatic 
transmission, electronic sensors detect 
vehicle speed and throttle opening, and 
gears are shifted based on the prede- 
termined value of these factors. Ac- 
cording to Nissan, this type of system 
is incapable of always presiding satis- 
factory control performance to a driv- 
er because it prorides at most only 
about three different shift patterns. 

But the Nissan fuzzy control trans- 
mission, (patent number 4,M1,S15), is 
more flexible and provides a driver 
with more control performance be- 
cause it is operated by sensors that 
assign values to numerous variables, 
including vehicle speed, throttle open- 
ing, acceleration and the rate of 
change of the throttle opening. Each 
value is given a weight, and the 
weights are calculated to make the de- 


Bodv/Chassis ImraM 

‘Fuzzy Logic’ ABS, Gearbox 

FUZZY LOGIC CONTROLLED ABS 



ANTHROPOMORPHIC: Nissan s fuzzy logic program is designed to appl 
human reasoning characteristics to the co .trol module of its paxemed AB 
design. 


cision on whether to shift gears. 

Where conventional ABS i n corp orat e 
sensors that detect vehicle and wheel 
speed, the Nissan system’s (patent 
number 4,142442) control unit mea- 
sures these variables in addition to de- 
rivatives of wheel speed with respect 
to time and derivatives of vehicle 
speed with respect to time. As in the 
transmission, certain signals in the 
brake system are assigned weighted 
values that determine the frequency of 
ABS brake actuation. 

In a paper entitled "Making Comput- 
ers Think Like People," Mr. Zadeh ex- 
plained that fuzzy logic allows comput- 
ers to handle such imprecise human 
concepts as “small." “big." ’*young" 
and "old" by describing them is rang- 
es of number? instead of exact terms. 

DEVELOPMENT OF FUZZY logic in 
the early 1970s by Ebrahim Mam dam, 
a control engineer at Queen Mary Col- 
lege in London, and Sc to Assiliaa, Mr. 
Mamdani's student at that time, has 
led to growing interest in the use of 
this theory in such applications as in- 
dustrial proc es s control and automo- 


bile engine control, said Mr. Zadeh. 

Japan in particular has shown 
peat deal of interest a fuzzy logic 
Research is being e ndocted in Jape 


in the application H flas system i 
such areas as vUiIze control at th 
Tokyo Institute of Technology's Suger 
Laboratory, and robot cont rol at Hose 
Universitv's Hirota Laboratory'. 

In Mar^h^apan’S Ministry of Inter 
national Trade and Industry esu: 
lisbed the Laboratory for lntematiora 
Fuzzy Engineering Research (LIFE 
a group that consists of 4* mem be 
Japanese firms, includi ng Nissan. 

A fuzzy system dev el oped by Hiu 
chi, also a member of the new LIF 
organization, is already used to contre 
subway trains in Sandal, Japan. 

Fuji Heavy Industries 1ML, the mal 
er of Subaru cars, is developing a 
advanced form of electronic contim 
,oush* variable transmission, called th 
ECVT-IL that also uses fuzzy contro:: 
The ECVT-I1 is not m production no 
and is not expected to appear in a 
automobile before model year 1991. a 
cording to a spokesman at Subart: c 
America, Cherry HiH, N-J.O 
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FUZZY LOGIC-BASED COMMAND 
SYSTEM FOR ABS 


FUZZY 
LOGIC 
BASED 
COi *AND 
MODULE 


(FEED-FORWARD) 

[COMMAND 
WHEEL VELOCITY 


SUPPLEMENTARY COMMAND 
HYDRAULIC PRESSURE 


REGULATOR 



WHEEL 
VELOCITY 


HYDRAULIC 

SERVO 



VEHICLE 

VELOCITY 


HYDRAULIC PRESSURE 


(UNKNOWN) 
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FUZZY FEED-FORWARD CONTROLLER 
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o 


current projects in fuzzy control 

by 

Michlo Sugeno 

Tokyo Institute of Technology 






Fuzzy Logic Workshop 
14 November 1990 
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Projects of Helicopter Flight Control^ 

o Radio Control by Oral Instructions 

Cmh - im) 

Tokyo Institute of Technology 
supported by Science and 
Tecknoloyy Af*ney 

o Automatic Autorotation. Entry 

in. FfliW® 

(HM— IW) 

Kawasaki Hevy I niustry / TIT 
supported by STA 

o Unmanned Helicopter for Sea Rescue 

(Wo— Wl) 

TOKIHEC/TIT 

supported by Ministry ef 
Transportation. 




Control. of Movements 


( 


ove Control, 


up /down, 

<£■ — lift of main rotor 


(collective pitch, level. 

forvttd/tockwd 4— wwn rotor revolutho 

• 

( longitudinal stick) 

left / right 

4— »*main rotor revolution 

surface 


(lateral stick) 

nose direction 

UAttllRfl. 

4 — - lift of tafia rotor 

(left /right) 

(directional pedal) 

• 
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Remote Control of Helicopter 
by Orel Instructions 

Fig. Strei$kt 





Automatic Autorotation Entry 


Engine Failure 





Autorotation. Entry 



t 
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Unmanned Helicopter for Sea Rescue 



Satellite 


position, infomation 


Mothership 




control instruction 
video information 


F^\ 1M 

r „ 

keHtl \ 



PjltHI fOW 

l 


■Men 



Firing. Ship 
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Linguistic Rules for Hovering 

I 

1) If the body rolls, then control 

the lateral in reverse 

2) If the body pitches, then control 

the lonei* in reverse 

5) If the nose turns, then control 
the pedal in reverse 

4) If the body moves sideways, then 

control the lateral in reverse 

5) If the body moves bach and forth, 

then control the Sony*, in 
reverse 

6) If the body moves up and down, 

then control the collective 

in reverse 


Fuzzy Control Rules -for Hoverii? 
(f.onut. stick control.) 


1) pitck is PO 

2) ♦ NE 


3) ^ P'tek is PO 

4) * NE 

5) X is PO 

6) * NE 



-» ftonji. is NE 
-» * PO 

— ¥ £on^i . is NE 

-» * po 

— > Ioa|i. is NE 
-» » PO 

£on|i. is NE 

-* ❖ PO 






Auto rotation Entry by Fuzzy Control 

( keep rotation speed of wain rotor) 


Engine Failure 

ut i 









TERMINOLOGY AND CONCEPTS 
OF CONTROL AND FUZZY LOGIC 

Presented at 

A Workshop on Fuzzy Control 
Huntington Beach, CA 
14 November 1990 


Dr. Jack Aldridge, MDSSC- SSD (Houston) 
Dr. Robert Lea NASA/JSC 
Dr. Yashvant Janl Llncom Corp. 

Dr. Jonathan Weiss MDSSC-SSD (Houston) 
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PURPOSES OF THIS TALK 


MCDONNELL DOUGLAS 



• Briefly review control history - how do ideas "fit together 

. Establish terminology of control theory and fuzzy logic to 
promote useful discussions 

. Establish basic concepts^) both areas for the same purpose 


/ 
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CONTROL SYSTEMS 

• A means by which a variable quantity or a set of variable 
quantities is made to conform to a prescribed norm or to vary in a 
prescribed way 


• May be operated by electrical means, mechanical means, 
hydraulic means, pneumatic means, or a combination 
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CONTROL THEORY WAS FORMULATED IN THREE PHASES 


MCDONNELL DOUGLAS 



Classical 


Modem 



mol 11960 


Frequency Domain Methods from 
Communication Developments 


State Space Formulations 


1980 


1990 


Fuzzy 


Exact Formulation Of Control 
on a Case-by-Case Basis 


Multiple Application Techniques - M Dynamical 
A Theory of Control H Systems 


Linear/Simple Nonlinear Systems M^BNonl inear Systems 










) 


ISSUES IN THE DESIGN OF A CONTROL SYSTEM 

■wwbm MCDONNELL DOUGLAS wvnmpmv iiiiiim 

Stability and Transient Response 
Response Time or Bandwidth 
Observability 
Controllability 

8 Continuous or Sampled Data 

Single or Multiple Control Loops 
Optimizing or "Near-Optimal" Control 
Fixed, Adaptive, or Learning Control 


EXAMPLES: INVERTED PENDULUM 


MCDONNELL DOUGLAS 


S 


Control Problem: 
Determine a control 
force, f, applied to the 
cart (pivot point) to keep 
pendulum at fixed angle 



STATE SPACE CONTROL FOR INVERTED PENDULUM 

' MCDONNELL D0U6LHS 




Equations of Motion 


State 


• • 


:2 


(M+m) z + mJ2cos90- m£8 sin0= f 


2 ** 

mJ0cos0z + mH 0 - mgJ^sin 9 = 0 


State Space Description of Dynamical System 
z = v 

V - mP(i)lln 8 • macosSsin 6_ + 1 

M + m sin 2 0 M+m sin 2 0 M + m sin * 9 

0 = 0 ) 

M = g sin9(M + m) • m(i)lin 6 - fcos 0 

w j0[M + m sin 2 0) M + m sin 2 0 M + m sin 2 © 
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LINEARIZED STATE SPACE 


MCDONNELL DOUGLAS 






mqe 

M 


to 


= (M+m)q® 

Mil 


_L 

Mil 


UnMMMInvfwnd 
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DYNAMICAL SYSTEM MODEL FOR 
INVERTED PENDULUM ON A CART 
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i/n 



mg/Tt 


i/nt 


(W+m)g/Ptf 







PROPORTIONAL-INTEGRAL-DERIVATIVE (PID) 

CONTROLLER 



u(t) 


Proportional component reduces error 
Integral component reduces steady state offset 
Derivative component anticipates and reduces overshoots 



ADVANTAGES OF USING CONVENTIONAL CONTROL 


MCDONNELL DOUGLRS 


• Technology Is well established 

• Many control problems are well approximated by linear plants 
or can be handled with adaptive systems that perturb controller 
parameters 

• Technology is mathematically based allowing general properties 
of controllers to be explored by a theoretical approach 


PROBLEMS WITH STATE SPACE CONTROL? 


MCDONNELL DOUGLAS 



• Model building stage is elaborate, iterative, error-prone, and 
time consuming 

• A performance index that can be used for optimization must 
be formulated 

• Actuators may be nonlinear 

• Complex equipment may be poorly described by systems of 
differential equations but may be best described from 
experimental data or heuristics (rules of thumb or experience) 

• Heuristics may be part of the operating procedure and may 
be based on mental models other than the physical models 
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FUZZY CONTROLLER OVERVIEW 

MCDONNELL DOUGLAS 

' Fuzzy Oorirolf 

DESIGNER-SUPPUED 

FtlZZV INFORMATION IS UNDERLINED 

Set 

Membership Defuzzif jer 

Functions IF...THEN... Rules Techniques 



Inputs Fuzzifier Rule Processing Defuzzifier Outputs 













f\J/\SA MISSION SUPPORT DIRECTORATE JSC 
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Angle Rate 
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RULE BASE FOR FORCE ON INVERTED PENDULUM CART 



Example Rule: IF Angle is PS AND Angle Rate Is NS THEN Force Is ZO 





» ui& w « 


FUZZY RULE PROCESSING 


MCDONNELL DOUGLAS 


USE MAXIMUM FOR LOGICAL OR 


IF ... THEN u Is NS .3 
IF ... THEN u is ZO .8 
IF ... THEN u is PS .1 
IF ... THEN u is PB .3 



USE MINIMUM FOR LOGICAL AND 

Rule: IF xl is NS AND x2 is ZO 
THEN u is PS 

Facts: 

xl is NS 0.2 

x2 is ZO 0.8 => u is PS 0.2 


Other options exist for 
combining logical 
connectives but these 
preserve all results 
from normal set theory 
except exclusion law: 
A AND NOT A = o 
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DEFUZZIFICATION 

ihiiwwm MCDONNELL DOUGLAS 


MAX Procedure 



u o 

inriftYftd MAX or Centroid Procedure 

Same as above except use only points > threshold value 
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FUZZY CONTROLLER ADVANTAGES 

• Can exploit heuristic knowledge of operation of controlled 
systems. This includes physical intuition. 

• Can accomodate small changes in system or controller 
parameters. This are the aging effect and nonlinear effects such 
as flexibility of beams 

• Experience has been that these techniques seem to handle 
nonlinearity well 

• Tools have been developed to assist in studying and building 
fuzzy controllers in short times 

• The development of fuzzy chips has provided computationally 
capable platforms on which to build the controller, independent of 
general purpose computers used for spacecraft control 


REMAINING ISSUES FOR FUZZY CONTROL 
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• Issues such as stability, observability, and controllability 
raised in servomechanism and state space control are not yet in 
comparable state of developmerit. This may limit initial 
applicability to noncritical applications 

• Definition of membership functions is arbitrary and controller 
designer dependent. 

• Procedures for selecting membership functions and defuzzifier 
options are not firmly established in the control community 

• There are limited sources for fuzzy control chips 
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Workshop on Fuzzy Control Systems 
and Space Station Applications, Nov. 14-15, 1990 
Huntington Beach, CA 


i 


I * 

(a) 



Outline 


1- General courses: 

- Intelligent Control: 

- Fuzzy Logic in Control 

- Neural Networks in Control 

- Artificial Intelligence in control 

- Hybrid Approaches 

- Uncertainty Management in Artificial Intelligence 

2- Hands on Experience 

- Experiments with robot arm (simulated and real hardware) 

- Cart-pole Balancing 

3- Ames Associate Programs 

- Spending time at Ames 

4- Collaborative work on development of fuzzy controllers 



Intelligent Control Course 
(Fuzzy Logic Control) 


- The basics of Fuzzy Set Theory 

- Fuzzy Sets Operations 

- Architecture of Fuzzy Logic Controllers 

- Coding the inputs 

- Setting up the control knowledge base 

- Conflict resolution and decision making 

- Decoding the outputs 

- Successful applications 

- Lab Prototypes 

- Commercial applications 

- Advantages and disadvantages 



Intelligent Control Course 
(Neurocontrol) 


- The basics of artificial neural networks 

- Artificial Neural Networks: 

- Interactive Activation Model 

- General Error Back-Propagation Method 

- ADALINE and LMS Algorithm 

- Cerebellar Model Arithmetic Computer (CMAC) Model 

- Competitive Learning Models 

- Advantages and disadvantages of Neurocontrol 

- Applications 



Intelligent Control Course 
(Al-hased Approaches) 


- The basics of Qualitative Reasoning 

- The basics of rule-based control 

- Applications 

- Advantages and Disadvantages 



Intelligent Control Course 
(Hybrid Approaches) 


NeuroFuzzy Control 

- Competitive Learning 

- Fuzzy Control with reinforcement learning 
Hierarchical control models 



Hands on Experience 


- Control experiments with 

- A simulated model of the robotics arm 

- The PUMA robot 

- A simulated model of the cart-pole balancing 

- The laboratory cart-pole balancing hardware system 

- The rendezvous-docking simulator for the Space Shuttle 

- Computing facilities to use the fuzzy computer chips 

- interfaced with a SUN work station 



Ames Associate Program 


Interested participants can spend time at Ames 
- Have to donate their time 
Can utilize the Ames facilities 
From two months to a year 



Issues for the Panel Discussion 


- Is Fuzzy Logic Control appropriate for this domain? 

- Does an analytical mathematical model exist for this problem 
or can It be developed within a reasonable time? 

- Who are the experts in this domain? how can their knowledge 
be modeled? 

- What steps (beyond the general methodology) have to be taken 

in order to develop a fuzzy logic controller for this problem? 

- How important are the stability issues? how can we validate the 

controller? 
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Overview of FUZZY Logic 

DESCRIBE CONTROL FACTORS: 

SPEED: stopped/very slow/slow/fast/very fast 

Distance to DESTINATION: at/very near/near/far/very far 

ACTIONS: 

BRAKE: no/slight/medlum/full 

THROTTLE: no/slight/medium/full 

RULES: 

1. If SPEED Is slow and DESTINATION Is very near 
then medium BRAKE 

2. If SPEED Is very slow and DESTINATION Is very near 
then medium BRAKE 

3. If SPEED Is very slow and DESTINATION Is at 
then full BRAKE 


10. If SPEED Is slow and DESTINATION Is very far 
then medium THROTTLE 


TRUTH VALUE 



Overview of FUZZY Logic 


SPEED is slow and 


90% 


DESTINATION Is near 


25% 


then 


medium BRAKE 


t(p & Q) = mln( t(P), t(Q) ) 


FUZZY logic: Combining Conditions 


Apt 



Overview of FUZZY Logic 


i if •••• 

Essas= ^^ 

.... then medium BRAKE 1 



if .... 

.... then medium BRAKE | 



t(A) = max{ t (A), t (A) ) 

R1 R2 


75% 

10 % 

75% 


FUZZY logic: Combining Actions 



Overview of FUZZY Logic 

1. If medium BRAKE 75% 

2. if medium BRAKE 10% 

10. if no BRAKE 50% 

slight BRAKE 


FUZZY logic: defuzzification 


averaging 
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Apt 
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Overview of FUZZY Logic 


Example of FUZZY diagnostic system 


AIRCRAFT ENGINE-FAULT DIAGNOSTIC SYSTEM (CHINA) 


✓ 12 subsystems 


✓ 800 factors 


✓ 600 faults 


✓ 89% successful in 3000 test cases 


/ 5 minutes computation 
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Overview of FUZZY Logic 


DIRECT 1MPLEMENTAION 


UMAN KNOWLEDG 


EASY TO DESIGN 
EASY TO ADJUST 
POSSIBLE TO ON-UNE EDIT 


INCOMPLETE KNOWLEDGE 
INCOMPATABLE RULES 


ROBUSTNESS 


Application aroaa: I— 

♦ Alr/ground traffic control 

♦ Multl-varlato dlagnoatloa 

♦ Chemical Engineering 

♦ Aeronautlca/Aatronautlce 


MAKE COMPLICATED SYSTEMS 
EASIER AND 

SOLVE OPEN PROBLEMS 


Effective and 
uaer-friendly 
Development 
Environment 







SINGLE-CHIP 
CONTROLLER 
very low cost j 

► Laundry machines 

► Air conditioners 

► Video cameras 

► Servo motors 

► Smart bombs 


MULTI-TASK 

GENERAL-PURPOSE CHIP 
(added to host computer) 

^ high performance ^ 

► Automobiles 

► Trains 

► Robots 

► Assembly lines 

Simplicity of Computation 


STAND-ALONE 
FUZZY CONTROLLER 
(with CPU, linked 

Into network) 

^ _ . 

► Manufacturing 
centers 

► Diagnostic 
systems 


i 


Apt 






Overview of FUZZY Logic 


AN ALTERNATIVE TO 
CONVENTIONAL 
NUMERIC METHODS 


FUZZY VERSIONS OF: 
INTERPOLATION 

FINITE ELEMENT METHOD 

LINEAR/NON-LINEAR 

PROGRAMMING 


APPLICATIONS: 

✓ COMPUTER GRAPHICS 

✓ GRAPHICS PRINTERS 

✓ CIVIL ENGINEERING 


I 



CASE STUDY - SENDAI SUBWAY SYSTEM 


MAXIMUM SAFE SPEED 



DISTANCE 
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CASE STUDY - SENDAI SUBWAY SYSTEM 


PID CONTROL 


V 


, cr =10 cm 


- FUZZY 
CONTROL 


Precision of Stop at station 


I 10 

JO 

o 

L 

O 



Evaluation of precision and comfort 



Apt 
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Evaluation of Power Consumpton and Run Time 



Apt 
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Kosko, B., NEURAL NETWORKS AND FUZZY SYSTBS, Volume I, Prentice-Hall, 1991 
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CHAPTER 1 


NEURAL NETWORKS AND FUZZY 
SYSTEMS 


From causes which appear similar, we expect similar effects. This is the sum 
total of all our experimental concisions. 

David Hume 

An Inquiry Concerning Human 
Understanding 



A learning machine is any device whose actions are influenced by past expert- 
ences . 

Nils Nilsson 
Learning Afac/unes 


Man is a species that invents its own responses. It is out of this unique ability 
to invent, to improvise, his responses that cultures are bom. 

Ashley Montagu 

Culture and the Evolution of Man 
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neural and 


fuzzy machine intelligence 
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Neural Pre-Attentive and Attentive Processing 
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this stimulus pattern: v®»jk dBtk 
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bright interior- We see illusory boundar.es. Or 

Technically we do not see "there" in physica! re^ity on the page. 

The Kanizsa square exists in our brain, no 

Out there only four symmetric ink patterns stai pag (1783-87), the four 

U the terminology of eighteenth-century phiio^pher 

ink stains are noonteno, thing, in th«nnelv«. Ug P » „ mme ^ in dueed 

ana stimulate oor snrtaee restore. retrod neuron, « ^ Tk „ t 

sensation prodoce, the Kanirsa-square phenomenon or P P 

e, -rvAT^timc continuum without drams oi 
would be no Kanizsa squares m the spacetime con 

systems to perceive them. 
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Today we understand many of the neural mechanisms of perception that Kant could 
only guess at. The realtime interaction of millions of competing and cooperating neurons 
produces the Kanizsa square illusion (Grossberg, 1987), and everything we “sec.” 

We take for granted our high-speed, distributed, nonlinear, massively parallel pre- 
attentive processing. In our visual processing we pay no attention to how we segment 
images, enhance contrasts, or discount background luminosity. When we process sound 
we pay no attention to how our cochleas filter out high-frequency signals [Mead, 1989) or 
how our auditory cortex breaks continuous speech into syllables and words, compensates 
for rhythmic changes in speech duration, and detects and often corrects errors in pronun- 
ciation, grammar, and meaning. We likewise ignore our realtime pre-attentivc processing 
in the other sense modalities, in smell, taste, touch, and balance. 

We experience these pre-attentive phenomena, but we ignore them and cannot control 
or completely explain them. Natural selection has ensured only that we perform them, 
ceaselessly and fast. 

Attention precedes recognition. We recognize segmented image pieces and parsed 
speech units. An emergent “search light,* perhaps grounded in thalamic neurons (Crick, 
1984], seems to selectively focus attention in as few as 70 to 100 milliseconds. We look, 
see, pay attention, then recognize. 

Neural network theory studies both pre-attentive and attentive processing of stimuli. 
This leaves unaddressed the higher cognitive functions involved in reasoning, decision mak- 
ing, planning, and control. The asynchronous, nonlinear neurons and synapses in our bram 
perform these functions under uncertainty. W r e reason with scant evidence, vague concepts, 
heuristic syllogisms, tentative facts, rules of thumb, principles shot through with excep- 
tions, and an inarticulable pantheon of inexact intuitions, hunches, suspicions, beliefs, 
estimates, guesses, and the like. 

Natural selection evolved this uncertain cognitive calculus. Our cultural conditioning 
helps refine it. A fashionable trend in the West has been to denigrate this uncertain- 
ty calculus as illogical, unscientific, and nonrigorous. We even call it “fuzzy reasoning” 
or “fuzzy thinking.” Modern philosophers [Churcbland, 1981) often denigrate the entire 
cognitive framework as “folk psychology." 
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Yet we continue to use our fuzzy calculus. With it we run our lives, families, careers, 
industries, hospitals, courts, armies, and governments. In all these fields we employ the 
products of exact science, but as tools and decision aids. The final control remains fuzzy. 

FUZZINESS AS MULTIVALUEDNESS 

Fuzzy theory holds that all things are matters of degree. It mechanizes much of our 
“folk psychology." Fuzzy theory also reduces black-white logic and mathematics to special 
limiting cases of gray relationships. Along the way it violates black-white “laws of logic," 
in particular the law of noncontradiction not-(A and not- A) and the law of excluded middle 
either A or not-A , and yet resolves the paradoxes or antinomies (Kline, 1980] that these 
laws generate. Does the speaker tell the truth when he says he lies. Is set A. a member 
of itself if A equals the set of all sets that are not members of themselves? Fuzziness also 
provides a fresh, and deterministic, interpretation of probability and randomness. 

Mathematically fuzziness means multivaluedness (Rosser, 1952; Rescher, 1969] and 
stems from the Heisenberg position-momentum uncertainty principle in quantum mechan- 
ics (Birkhoff, 1936]. Three-valued fuzziness corresponds to truth, falsehood, and indetermi- 
nacy, or to presence, absence, and ambiguity. Multivalued fuzziness corresponds to degrees 
of indeterminancy or ambiguity, partial occurrence of events or relations. 

Bivalent Paradoxes as Fuzzy Midpoints 


Consider the bivalent paradoxes again. A California bumpersticker reads TRUST ME. 
Suppose instead a bumpersticker reads DON’T TRUST ME. Should we trust the driver? 
If we do, then, as the bumpersticker instructs, we do not. But if we don’t trust the driver, 
then, again in accord with the bumpersticker, we do trust the driver. The classical liar 
paradox has the same form. Does the liar from Crete lie when he says that all Cretans are 
liars? If he lies, he tells the truth. If he tells the truth, he lies. Russell’s barber is a man 
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in a town whose advertises his services with the logo “I shave all, and only, those men who 
don’t shave themselves." Who shaves the barber? If he shaves himself, then according to 
his logo he docs not. If lie docs not, then according to his logo he docs. Consider the card 
that says on one side “The sentence on the other side is true," and says on the other side 
“The sentence on the other side is false*" 

The “paradoxes” have the same form. A statement 5 and its negation not-S have the 
same Iruth-valvc t(S): 

t{S) = 1 (not-S) . (1) 

The two statements are both TRUE (1) or both FALSE (0). This violates the laws of . 
noncontradiction and excluded middle. For bivalent truth tables remind us that negation 
reverses truth value: 


t (not-S) = 1 - t(S) . ' (2) 


So (1) reduces to 


t(S) = 1 - *(S' - (3) 

If 5 is true, if *(S) = 1, then 1 = 0. t{S) = 0 also implies the contradiction 1=0. 

The fu zzy or multivalued interpretation accepts the logical relation (3) and, instead of 
insisting that i{S) — 0 or ((5) = 1, simply sohes for t[S) in (3). 


2 t(S) = 1 , - (4) 

or 

<(S) = i . < 5 > 

So the "paradoxes” reduce to literal half-truths. They represent in the extreme the uncer- 
tainty inherent in every empirical statement and in many mathematical statements. Geo- 
metrically, the fuzzy approach places the paradoxes at the midpoint of the l-dimensional 
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unit hypcrcube [0, lj. More general paradoxes reside at the midpoint of n-dimcnsional 
hypcrcubes, the unique point equidistant to all 2* vertices. 

Mullivalucdncss also resolves the classical sorites paradoxes. Consider a heap of sand. 
Is it still a heap if we remove one grain of sand? How about two grains? Three? If we 
argue bivalently by induction, we eventually remove all grains and still conclude that a 
heap remains, or that it has suddenly vanished. No single grain takes us from heap to 
non-heap. The same holds if we pluck out hairs from a nonbald scalp or remove 5%, 10%, 
or more of the molecules from a table or brain. We transition gradually, not abruptly, 
from a thing to its opposite. Physically we experience degrees of' occurrence. In terms of 
statements about the physical processes, we arrive again at degrees of truth. 

Suppose there arc n grains of sand in the heap. Removing one grain leaves »i — 1 grains 
and a truth value l(S„_i) of the statement S„_i that the n — 1 sand grains are a heap. 
The truth value t(S„-i) obeys < 1 in general. *(S n _i) may be close to unity, 

but we have some nonzero doubt d*-\ about the truth of the matter. (The argument still 
holds if there exist no doubting creatures in the universe.) For instance [Gaines, 1983], 

t(S.) = 1 - <U , (6) 

where 0 < d» < dn-i < --- < <£.-■» < < 1. So t(S„_ m ) approaches zero 

as m increases to n. If we argue inductively, we can interpret the overall inference as the 
forward chain “(If S„, then S n _j) and (If S„_i, then S n -i) and ... and (If Si, then So)." 
If we multiplicatively interpret the conjunction operator, then 

i(S . — s„_ m ) = n (1 - dn-k) ■ (7) 

k=0 

If we interpret the conjunction operator as the minimum operator, as discussed in the 
homework problems at the end of the chapter, then 


l(S„ — S„_ m ) = min(l - <U, -, 1 - d n . m ) . (8) 
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= 1 - max(d„, ..., dm-m) • 


(9) 


In both cases the implication truth value l(S n — ♦ 5 0 ) equals zero (or some small number). 
We pay a truth-value fee for each application of modus ponens , of concluding D from A 

and 4 The overall inference is vacuous. This reflects the everyday epistemological 

precept that the longer an explanation, the less we tend to trust it. 


Fuzziness in the Twentieth Century 

Logical paradoxes and the Heisenberg uncertainty principle led to the development 
of continuous or fuzzy” logic in the 1920s and 1930s. Quantum theorists allowed for 
indeterminacy by including a third or middle truth value in the bivalent logical framework. 
The next step allowed degrees of indeterminacy, viewing TRUE and FALSE as the two 
limiting cases of the spectrum of indeterminacy. 

Polish logician Jan Lukasiewicz (Rescher, 1969] first formally developed a three-valued 
logical system in the early 1930s. Lukasiewicz extended the range of truth values from 
{ 0 , 1 / 2 , 1 } to all rational numbers in ( 0 , 1 ], and finally to all numbers in ( 0 , 1 ] itself. 
Logics that use the general truth function t: {Statements} — ♦ (0, 1] define contmous 
or fuzzy” logics. Logicians refer to this system as Lt- The exercises at the end of the 
chapter develop Lukasiewicz’s fuzzy logic. 

In the 1930s quantum philosopher Max Black (1937] applied continuous logic compo- 
nentwise to sets or lists of elements or symbols. Historically, Black drew the first fazzy-set 
membership functions. Black called the uncertainty of these structures vagueness. Antici- 
pating Zadeh’s fuzzy set theory, each element in Black’s multivalued sets and lists behaved 
as a statement in a continuous lope. 

In 1965 systems scientist Lotfi Zadeh (1965] published the paper Fuzzy Sets that 
formally developed multivalued set theory, introduced the term fuzzy into the technical 
literature, and inaugurated a second wave of interest in multivalued mathematical struc- 
tures, from systems to topologies. The recent emergence of fuzzy commerica! products, as 
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well as new theory, has generated a third wave of interest in multivalued systems. 
Zadclt extended the bivalent indicator function J A of non fuzzy subset A of X, 


f 1 if x € A 
[ 0 if x $ A 


(10) 


to a multivalued indicator or membership function m A : X — ♦ (0, 1). Tins allows 
us to combine sudi multivalued or fuzzy sets with the pointwise operators of indicator 

functions: 


I A n b( x ) = min(/ x (x), /fl(x)) . ( n ) 

I A u b(x) = max(fA(x)i Ib{ x )) > < 

Ia‘( x ) = 1 ~ M x ) » 

A C B iff I A (x) < H x ) for all x in X . (14) 


The membership value m^i) measures the dementhood or degree to which element x. 
belongs to set A: 

m A (x) = Degree(x € A) . (I 5 ) 

Just as the individual indicator values /^(x) behave as statements in bivalent propositional 
calculus, membership values m A (x) correspond to statements in a continuous logic. If A 
defines a fuzzy subset of the real line, as in Figure 1.7 below, then in principle we can 
graph m A : R — ♦ (0, 1) in two dimensions. In practice indicator functions I A graph as 
step functions or rectangular pulses on the real line. 
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Sets as Points in Cubes 


Fuzziness prevents logical certainty at the level of black-white axioms. This seems 
unsettling to some [Quine, 1981) and liberating to others. 

At the system level fuzziness allows us to build computer chips and systems that “in- 
telligently" control subways, automobile systems, and numerous consumer electronic and 
other devices. At this level fuzzy processing may resemble neural processing. 

Neural networks and fuzzy systems process inexact information and process it inexact- 
ly. Neural networks recognize ill-defined patterns without an explicit set of rules. Fuzzy 
systems estimate functions and control systems with partial descriptions of system behav- 
ior. Experts may provide this heuristic knowledge, or, as we illustrate in Chapters 17-19, 

neural networks may adaptively infer it from sample data. 

Nekral and fuzzy systems share a more formal mathematical property. They sb*re the 
same state space. A set of n neurons defines a sequence of n-dimension?l continuous or 

“fuzzy” sets. The neurons emit bounded signals. 

The neuronal signals range from some minimum value to some maximum value, say 
from 0 to 1. At each instant the n-vector of neuronal outputs dell es a fuzzy unit or fit 
vector. Each fit value indicates the degree to which the neuron or element belongs to the 
n-dimensional fuzzy set. 

The neuronal state space, the set of all possible neural outputs, equals the set of all n- 

dimensional fit vectors, the fuzzy power set Both equal the unit hypercube i" = (0, 1)' = 

(0,1) x ... x [0, 1), the set of all vectors of length n and with coordinates in the unit 
interval (0, 1). Chapter 17 discusses fuzzy systems and associative memories, which map 
unit cubes to unit cubes, fuzzy sets to fuzzy sets. We shall use this recent geometric view 
of sets as paints (Kosko, 1987-90) throughout this book. 

The 2“ vertices of /“ represent extremized neuronal-output combinations, as we often 
find in networks of competitive or laterally inhibitive neurons. Many feedback neural net- 
works [Hopfield, 1984) drive initial states inside the unit cube to nearest vertices. These 
systems dynamically disambiguate fuzzy input descriptions by minimizing their fuzzy en- 
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X= (t 1) 


(x 2 } = (0 1) 


XI 


0=(O 0) 


xt 


(X|} = (1 0) 


pjQURE 1.1 Fuzzy power set F(2 X ) of X corresponds to the unit square 
when X = {xi, x 2 }. The four nonfuzzy subsets in the nonfuzzy power set 2 X 
correspond to the four comers of the 2-cube. The fuzzy subset A correponds 
to the fit vector (1/3, 3/4) and to a point inside the 2-cube if m*(xi) = 1/3 
and nu(xj) = 3/4. The midpoint M of the unit square corresponds to the 

maximally fuzzy set. 


(. 


Figure 1.1 represents the fuzzy subset A as a point inside the 2-dimensional unit hyper- 
cube. If A has membership degrees or fit values m j4 (xi) = 1/3 and m A (x 7 ) = 3/4— so 
i, belongs to A less than x 2 does— then A corresponds to the fit vector (1/3, 3/4). 

The cube midpoint corresponds to the maximally fuzzy set M. The midpoint set M 
uniquely obeys the peculiar relation M = MnM e = MuM e = M e , and so 
maximally violates the bivalent laws of noncontradiction and excluded middle. The clas- 
sical paradoxes of logic and set theory correspond to midpoint phenomena. Note that the 
cube midpoint in Figure 1.1 is uniquely equidistant to all 2 7 vertices. The cube midpoint 
behaves as the black hole of set theory. 
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Subscthood and Probability 


Elcmcnthood represents a special ease of subscthood. Subscthood measures the degree 
to which set A belongs to set B, the degree to which A is a. subset of B . We denote this 
subscthood measure as S(A, B): 

S(A, B) = Degree(A C B) . (16) 

Subscthood provides a unified set-theoretic framework for fuzziness and probability. For 
instance, in the simplest case A equals the singleton s et {x.-}. Then the subsethood of {x.} 
in B equals the membership or elcmcnthood value mfl(x;): 


S({x;}, B) = , ( 17 ) 

(17) follows directly from the Subsethood Theorem (22) below when we interpret (x.) as 
a bit vector with a 1 in the ith slot and Os elsewhere. 

Subsethood reveals the connection between fuzziness and randomness. Subsethood re- 
duces probability to set theory. Randomness does not depend on the fuzziness or ambiguity 
of an event. It depends on the uncertainty between certain events. Randomness equals 
the uncertainty that arises when a nonfuzzy set B is partially contained in one of its own 
nonfuzzy subsets A. S(A , B) = 1 since A is a subset of B. But in general multivaluedness 
holds. The converse subsethood S{B, A) is less than one but greater than zero: 

0 < S[B, A) < 1 . ( 18 ) 

Classical set theory implicitly forbids the strict inequalities in (18). The law of excluded 
middle dictates that every set either is or is not a subset of every other set. As a result, 
for centuries theorists have had to arbitrarily define probability as a frequency ratio or 
stipulate that it obeyed certain axioms. They could not derive probability from more 
fundamental concepts. 

Fuzzy theory derives the axioms of the conditional probability measure P(B\A ), 
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. „ PIA n D) 
P(D\A) = • 


( 19 ) 


the probability that D occurs given that A occurs, from the properties of the subsethood 
measure S(A, D). If A' defines the “sample space” of all elementary outcomes of an 
experiment, then X is a “sure event" since P(X) = 1. Then (19) implies that every 
probability P(A) equals the conditional probability /°(A|A'): 


P(A) = P(A\X) . 

This identity reflects the general subsethood relationship 


( 20 ) 


P{A) = S(A', A) . ( 21 ) 

On the surface the subsethood relation (21) seems absurd. How can superset X belong 
to one of its own subsets? How can the whole be part of one of its own parts? X cannot 
totally belong to A unless X = A. But X can partially belong to A. The Subsethood 
Theorem in Chapter 16 proves that this partial containment depends directly on the over- 
lap between X and A, the intersection X D A. Figure 1.2 illustrates the Pythagorean 
geometry of the Subsethood Theorem in three dimensions. The shaded hyper-rectangle 
defines F( 2 s ), the fuzzy power set of B. 
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FUZZY SUBSETHOOD 



FIGURE 1.2 Subsethood Theorem in /i 3 . X contains 3 elements, x u x 2 , 
and X 3 , and 8 nonfuzzy subsets. Fuzzy subset B = (1/4, 1/2, 1/3) contains 
infinitely many fuzzy subsets B' such that S^, B) = 1. They define the 
shaded hyper-rectangle. S(v4, B) < 1 since A Ues outside the hyper-rectangle. 
The closer A to the hyper-rectangle, the larger the subsethood S{A , B). B~ 
denotes the subset of B closest to A. B’ equals .4 n B and uniquely defines an 
orthogonal or Pythagorean relationship between A and B. 


The Subsethood Theorem relates 5(^1, B) to the magnitudes of A, B, and .4 n B 


SM, B ) 


A/(.4 n B) 

M(A) 


( 22 ) 


The ratio in (22) resembles, behaves as, and generalizes the defining ratio (19) of conditional 
probability. M{A) denotes the fuzzy count of fit vector .4: 








/ 



M{A) = «! + ••• + 


(23) 


M(A) generate U,e classical cardinality ennni, riU sums only Is mi Os. W« 
ease appropriate Integra, s replace summations. (22) «■>' Ure tey etepy eW 

of A equals the degree to which ACi A* contains its own superset AUA t E (A) - S.M 

"'Z'iZlXA = P/4. 1/2. l/») ^ B = 0/4. -A I/’)- T„en the efosest 

subset B * to A that satisfies the total-subsethood cond.tion 


61 < 6i, . . • » 6„ ^ 6„ 


(24) 


corresponds to 5 ' = ( 1/4 1/2 1 / 2 ). which also equals the pairwise minimum of A and B. 
(24) generalizes (14) above As discussed in Chapter 16, the Subsetheod Theorem ensures 

this in general: 


B m - A n B 


(25) 


[23) implies that M(A) = 16/42 = 6/4, and M(A O B) = 3/4. Then the Subsethood 

Thetrem gives S(A,B)=(3/4)/(6/4) = 2/5 = 60%. ^ 

Relative frequency presides the dearest example of between-** fuzz, ness. ppose 
«„ a coin, draw bdls from urns, or shoo, at a target. The elementary events m X are 
trials Each trial is successful or unsucessful. So X does no. possess fuzzy subsets 
.vent space (its sigma-algebra). Each coin Hips results in a head or a tatl, no. 
in between. Suppose A defines the subset of sucressful trials. If X conUtns n tnaMhen 
A corresponds re a vertex of /* and equals a bit vector of Is »d Os. Suppose na sucres** 
out of n trials. Is indicare success*, and Os indicate failure* The ^ ^ ^ 

success, the bit vector of all Is. X contains » successes. Then, smee A . A 

Subsethood Theorem (22) gives 

orj, 41 _ Hi (26) 

S(X, A) n 


L. 


142 


Historically prob;i>ility theorists have called the subsethood ratio in (2G), or its limit, 
the “probability of success" or P(A). This adds only a cultural tag. The success ratio 
n A /n behaves no differently in its deterministic subsethood framework than it did in its 
“random” framework. The relative-frequency ratio still provides a stable estimate for 
probability values in our physical, engineering, economic, and gambling models. U still 

implies all the theorems it has always implied. 

But we cannot derive the relative-frequency ratio from between-set relationships if we 
deny the strict inequality (18) and insist that subsethood is two-valued. Bivalence forces 

us to assume the ratio as a theoretical primitive. 

Whether by design or by accident we have historically followed the bivalent path in 
mathematics for almost 3,000 years. Bivalence has simplified our formal frameworks but 
at a cost. It has led to logical paradoxes (bivalent contradictions), unexplained primitives, 
and “randomness” in a universe that seems to obey physical laws and where every event 

has causes. 

THE DYNAMICAL SYSTEMS APPROACH TO MACHINE 
INTELLIGENCE: THE BRAIN AS A DYNAMICAL SYSTEM 

Several engineering and scientific disciplines study how adaptive systeim respond to 
stimuli. Electrical engineers study the topic as signal processing, nonlinear filtering, coding 
theory, circuit design, and adaptive control. Computer scientists study it as algorithm and 
automata theory, computer design, robotics, and artificial intelligence. Mathematicians 
study it as function approximation, statistical estimation, combinatorial optimization, and 
dynamical systems. Philosophers study it as epistemology, causality, and action. Biologists 
study it as neuroscience, biophysics, ecology, evolution, and population biology. Psycholo- 
gists study it as reinforcement learning, psychometrics, and cognitive science. Economists 
study it as utility maximization, game theory, econometrics, and market equilibrium the- 

ory. Cultural anthropologists study it as culture. 

We shall emphasize electrical engineering as we seek general principles of how adaptive 



systems process information. We call these principles machine intelligence principles. We 
shall draw freely from the related fields of engineering and science. 

The term artificial intelligence usually refers to the computer-scientific approach to 
machine intelligence. This approach emphasizes symbolic processing and tree search. AI 
has become the emblem for a popular computer-age view of the brain: brain = computer. 
This view ranges from classical science-fiction speculation (the computer HAL in 2001: A 
Space Odyssey) to proposed space-based weapons systems. 

We shall explore machine intelligence from a dynamical-systems viewpoint: brain = 
dynamical system. On this view a maple leaf falling to a potential-energy minimum on 
the ground better describes brain activity than does a computer executing instructions. 
The dynamical models wc shall study are cast as large systems of differential or differ- 
ence equations. The principles describe local or global interactions of nonlinear parallel 

processes. 

Some of these machine-intelligence principles and mechanisms may explain natural phe- 
nomena and processes. Some already extend our theoretical and mathematical knowledge. 
But ultimately they should help us build smarter machines. They should give rise to new 
computational devices-electrical, optical, molecular, plasma, fluid, or other devices. 

In this sense machine intelligence becomes an engineering discipline. Nearly a half cen- 
tury ago, Norbert Wiener [1948] outlined the first incarnation of such a machine-intelligence 
engineering. Wiener called it cybernetics . 

We shall focus our analysis on artificial neural networks and fuzzy systems. These new, 
related systems represent broad classes of ‘machine-intelligent- adaptive systems.^ Chap- 
ters 2 - 6 describe neural network theory. Chapters 7 - 15 describe engineering applications 
of neural networks. Chapters 16 - 19 present a geometric theory of fuzzy sets and systems 
and its neural extension to adaptive fuzzy systems. 


Neural and Fuzzy Systems as Function Estimators 

Neural networks and fuzzy systems estimate input-output functions. Both are trainable 



dynamical systems. Sample data shapes and “programs’ their time evolution. Unlike 
statistical estimators, they estimate a function without a mathematical model of how 
outputs depend on inputs. They arc model-free estimators. They “learn from experience’ 
with numerical and, sometimes, linguistic sample data. 

Neural and fuzzy systems encode sampled information in a parallel-distributed frame- 
work. Both frameworks are numerical. We can prove theorems to describe tbeir behavior 
and limitations. We can implement neural and fuzzy systems in digital or analog VLSI 
circuitry or in optical-computing media, in spatial-light modulators and holograms. 

Artificial neural networks consist of numerous, simple processing units or “neurons 
that we can globally program for computation. We can program or train neural networks 
to store, recognize, and associativcly retrieve patterns or database entries; to solve combi- 
natorial optimization problems; to filter noise from measurement data; to control ill-defined 
problems; in summary, to estimate sampled functions when we do not know the form of 
the functions. 

The human brain contains roughly 10“ or 100 billion neurons [Thompson, 1985). That 
number approximates the number of stars in the Milky Way Galaxy, and the number of 
galaxies in the known universe. As many as 10< synaptic junctions may abut a single 
neuron. That gives roughly 10“ or 1 quadrillion synapses in the human brain. The brain 
represents an asynchronous, nonlinear, massively parallel, feedback dynamical system of 
cosmological proportions. 

Artificial neural systems may contain millions of nonlinear neurons and interconnecting 
synapses. Future artificial neural systems may contain billions of real or virtual model 
neurons. In general no teacher supervises, stabilizes, or synchronizes these large-scale 
nonlinear systems. 

Many feedback neural networks can learn new patterns and recall old patterns simul- 
taneously, and ceaselessly. Supervised neural networks can learn far more input-output 
pairs, or stimulus-response associations, than the number of neurons and synapses in the 
network architecture. Since neural networks do not use a mathematical model of how a 
system’s output depends on its input — since they behave as model-free estimators-we can 
apply the same neural network architecture, and dynamics, to a wide variety of problems. 
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Like brains, neural networks rccogi izc patterns we cannot even define. We call this 
property recognition without definition. Who can define a tree, a pillow, or their own face 
to the satisfaction of a computer pattern-recognition system? These and most concepts we 
learn ostcnsivcly, by pointing out examples. We do not learn them as we learn the definition 
of a circle. We abstract these concepts from sample data, just as a child abstracts the color 
red from observed red apples, red wagons, and other red things, or as Plato abstracted 

triangularity from considered sample triangles. 

Recognition without definition characterizes much intelligent behavior. It enables sys- 
tems to generalize. Dogs, lizards, and slugs recognize multitudes of unforeseen, complex 
patterns without, of course, any ability to define them. Descriptive natural languages 
developed only yesterday in human evolution. Yet a great deal of modern philosophy, 
influenced by formal logic and behaviorist psychology, has insisted on concept definition 
preceding recognition or even discussion. Below we discuss how this insistence^ helped 
shape the field of artificial intelligence and its emblem, the expert system. 

Neural networks store pattern or function information with distributed encoding. They 
superimpose pattern information on the same associative-memory medium-on the many 
synaptic connections between neurons. Distributed encoding enables neural networks to 
complete partial patterns and “clean up” noisy patterns. So it helps neural networks 
estimate continuous functions. 

Distributed encoding endows neural networks with fault tolerance and “graceful degra- 
dation.” If we successively rip out handfuls of synaptic connections from a neural network, 
the network tends to smoothly degrade in performance, not abruptly fail. Computers and 
digital VLSI chips do not gracefully degrade when their components fail. Natural selection 
seems to have favored distributed encoding in brains, at least in sections of brains. 

Neural networks, and brains, pay a price for distributed encoding: crosstalk. Distribut- 
ed encoding produces crosstalk or interference between stored patterns. Similar patterns 
may clump together. New patterns may crowd out older learned patterns. Older patterns 
may distort newer patterns. 

Crosstalk limits the neural network’s storage capacity. Different learning schemes pro- 
vide different storage capacities. The number of neurons bounds the number of patterns a 
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ncutl | network on store reliably with the simplest « ..supervised learning schemes. Even 
(or more sophisticated supervised learning schemes, storage capacity ultimstely depmtd. on 
the number of network neurons snd synnpses, ss well ss on their (unction. Duncnsronehly 

limits capacity . 

Biological neurons and synapses motivate the neural network’s topology and dynmn.es. 
We interpret neurons as simple input-output (unctions, threshold switches (or two-state 

n and asymptotic threshold switches (or continuous neurons. We interpret synapse. 

as adjustable weights. In neural analog VLSI chips (Mead, 1989|, operational ampbfiere 

model nonlinear neurons, and resistors model synapses. 

The overall network behaves as an adaptive function estimator. Indeed commercial 
adaptive estimators me simple, usually liuem, neural networks. These include antennae 
bemn (onnere, high-speed modems, and echcrcancellers (or long-distance telephone calls. 


Neural Networks as Trainable Dynamical Systems 

Neural networks jeemelnre computation. Network activity burrows a trajectory in a 
state space oflarge dimension, my If. Emh point in the state space defines a snapshot 

of a possible neural network configuration. 

The trajectory begins with a computational problem and ends with a computational 
solution. The user or the environment specifies the system’s initial conditions, which 
define -here the trajectory begins in the state space. In pattern learning, the pattern to 
be learned defines the inilUl conditions. In pattern recognition or recall, the pattern to be 
recognized defines the initial conditions. 

Most ol the trajectory corresponds to irons, ’cni behavior or computations. Synaptic 
value gradually change to learn new pattern information. Neuronal outputs fluctuate. 

The trajectory ends where the system reache equilibrium, ifit ever reache equilibrium. 
In the simplest mid rarest case, the equilibrium attractor is a fixed point ol the dynmrocal 

Most popular neuml networks converge to fixed points. In more complicated case 

the equilibrium attractor is a limit cycle or limit torus. In Chapter 4 we discuss a crude 
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method for storing discrete time-varying patterns as limit cycles in feedback networks. The ( 

equilibrium attractors are robust or structurally stable if small perturbations do not distort 
or destroy them. 

In general, and in most dynamical systems, the equilibrium attractor is aperiodic 
or chaotic. Once the network enters this region of the state space, it wanders forev- 
er without apparent structure or order. Yao and Freeman [1990] have used dynamical 
neural models and time-series data to argue that rabbit olfactory bulbs process odor in- 
formation with chaotic attractors. As discussed in the homework problems, the function 
Xk+l _. c n (1 - it) behaves as a chaotic dynamical system for values of c near 4 and 

x values in the unit interval (0, lj. 

In Chapter 3 we discuss global Lyapunov functions for proving that certain feedback 
neural networks converge to fixed points from any initial conditions. Geometrically we can 
view the Lyapunov function as a surface sculpted by learned pattern information, as in 
Figure 1.3. 

Figure 1.3 illustrates the geometry of fixed-point stability in feedback neural networks. 

Patterns behave as rocks on the rubber sheet of learning. The patterns, as well as “spuri- 
ous* or unlearned patterns, dig out attractor basins in the state space and tend to rest at 
the local Lyapunov minimum of the attractor. The Lyapunov sheet changes shape as the 
system learns new patterns. Input patterns Q rapidly classify to nearest stored neighbors 
as if they were ball bearings rolling into local depressions in a gravity field. In a fixed-point 
attractor basins the state-trajectory balls stop at the local minima (or hover arbitrarily 
close to it). In limit-cycle attractors, the ball Q would rotate in an elliptical orbit inside 
the attractor basin. In limit-tori attractors, Q would cycle toroidally in the attractor basin, 
as if, in /Z 3 , winding around the surface of a bagel. In chaotic attractors, Q would wander 
aperiodically within the attractor region. 

In all these cases, the number of attractor basins does not affect the speed of conver- 
gence, the rate at which Q falls into the attractor basin. The dimensionality of the state 
space also does not in principle affect the convergence rate. In practice, Q converges ex- 
ponentially quickly. This suggests that global stability may underlie our biological neural 
networks’ ability to rapidly recognize patterns, generate answers, and exhibit appropriate 
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muscle reflexes independent of the amount of pattern information in our brains. Computer- 
type storage devices tend to slow as Hie number and complexity of patterns stored in them 

increases. . 



FIGURE 1.3 Global stability of a feedback neural network. Learning en- 
codes the vector patterns P u Pi, --• by gradually sculpting a Lyapunov or 
“energy" surface in the augmented state space /T +I . Input vector pattern Q 
rapidly “rolls” into the nearest attractor basin, where the system classifies Q 
as a learned pattern P or misdassifies Q as a spurious pattern. Q’s descent 
rate does not depend on the number of stored patterns. 


Mathematically we can describe the time evolution of the neural network by the (au 
lonomous) dynamical system equation 


Ht) = f(x) , 


(27) 



where the overdot denotes time differentiation. The state vector x(t) deicribes all neuronal 
and synaptic values of the neural network at time t. The neural network reaches steady 

stale when 


x = o , ( 28 ) 

holds indefinitely or until new stimuli perturb the system out .of equilibrium. Neural 
computation seeks to identify the steady-state condition ( 28 ) with the solution of a com- 
putational problem, whether in pattern recognition, image segmentation, optimization, or 

numerical analysis. 

We can locally linearize f by replacing f with its Jacobian matrix of partial derivatives 
J. The eigenvalues of J describe the system’s local behavior about an equilibrium point. 
For instance, if all eigenvalues have negative real parts, then the local equilibrium is a fixed 
point and the system converges to it exponentially quickly. More abstractly, generalized 
eigenvalues or Lyapunov exponents describe the underlying dynamical contraction and 

expansion that may produce chaos. 

We can classify neural network models according as they learn with supervision (pattern- 
class information) and according as they contain closed synaptic loops or feedback. Figure 
1.4 provides a rough taxonomy of several popular neural network models. 
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FIGURE 1.4 Taxonomy of neural network models. 




Supervised feedforward models provide the most tractable, most applied neural models* 
We discuss these stochastic gradient systems in Chapter 5, and mention recent attempts to 
extend these supervised systems into the feedback domain. Unsupervised feedback mod- 
els provide the most biologically plausible, but mathematically most complicated, models. 
These networks simultaneously learn and recall patterns. Both neurons and synapses 
change state when these systems learn and when they recall, recognize, or reconstruct 
pattern information. Chapter 6 proves global stability for many of these adaptive dynam- 
ical systems in the RABAM Theorem. Unsupervised feedforward neural networks tend to 
converge to locally sampled pattern-class centroids, as discussed in Chapters 4,6, and 9. 

Fuzzy Systems and Applications 

Fuzzy systems store banks of fuzzy associations or commonsense “rules." A fuzzy traffic 
controller might contain the fuzzy association “If traffic is heavy in this direction, then keep 


151 



the light grcccn longer." Fuzzy phenomena admit degrees. Some traffic configurations arc 
heavier than others. Some green-light durations arc longer than others. The single fuzzy 
association (HEAVY, LONGER) encodes all these combinations. 

Fuzzy systems are even newer than neural systems. Yet already engineers have suc- 
cessfully applied fuzzy systems in many commercial areas. Fuzzy systems “intelligently” 
automate subways; focus cameras and camcorders; tune color televisions, control automo- 
bile transmissions, cruise controllers, and emergency braking systems; defrost refrigerators 
and control air conditioners; automate washing machines and vacuum sweepers; guide 
robot-arm manipulators; invest in securities; control traffic lights, elevators, and cement 
mixers; recognize Kanji characters; select golf clubs; even arrange flowers. 

Most of these applications originated in Japan, though fuzzy products are sold and ap- 
plied throughout the world. Until very recently, Western scientists, engineers, and math- 
ematicians have overlooked, discounted, or even attacked early versions of fuzzy theory, 
usually in favor of probability theory. Below, and especially in Chapter 16 , we examine this 
philosophical resistance in more detail and present a new geometrical theory of continuous 
or “fuzzy” sets and systems. 

Fuzzy systems “reason” with parallel associative inference. When asked a question or 
given an input, & fuzzy system fires each fuzzy rule in parallel, but to different degree, to 
infer a conclusion or output. Thus fuzzy systems reason with sets, “fuzzy” or continuous 
sets, instead of bivalent propositions. This generalizes the Aristotelian logical framework 
that still dominates science and engineering. In one second a digital fuzzy VLSI chip 
may execute thousands, perhaps millions, of these parallel-associative set inferences. We 
measure such chip performance in FLIPS, fuzzy logical inferences per second. 

Fuzzy systems estimate sampled functions from input to output. They may use linguis- 
tic (symbolic) or numeric samples. An expert may articulate linguistic associations such 
as (HEAVY, LONGER). Or a fuzzy system may adaptively infer and modify its fuzzy 
associations from representative numerical samples. 

In the latter case, neural and fuzzy systems naturally combine. The combination 
resembles an adaptive system with sensory and cognitive components. Neural parameter 
estimators embed directly in an overall fuzzy architecture. Neural networks “blindly" 
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generate and refine fuzzy rules from training data. Chapters 17-19 describe and illustrate 
these adaptive fuzzy systems. 

Adaptive fuzzy systems learn to control complex processes very much as we do. They 
begin with a few crude rules of thumb that describe the process. Experts may give them 
the rules. Or they may abstract the rules from observed expert behavior. Successive 
experience refines the rules and, usually, improves performance. 

Chapter 18 applies this adaptive cognitive process to backing up a truck-and-trailer 
rig to a loading dock. (A supervised neural system can also solve this problem, though 
at much greater computational cost. So far the truck-and-trailer dynamical system has 
eluded mathematical characterization.) The fuzzy system quickly learns a set of governing 
fuzzy rules as it samples actual truck-and-trailer trajectories. Additional training samples 
improve only marginally the fuzzy system’s performance. This property is better experi- 
enced than explained. As an exercise for the reader, you might try backing your car into 
the same parking space five times from five different starting positions. 

INTELLIGENT BEHAVIOR AS ADAPTIVE MODEL-FREE 
ESTIMATION 

Below we discuss neural and fuzzy systems in more detail. First we examine the 
properties neural and fuzzy systems share with us and, more broadly, with all intelligent 
systems. These properties reduce to the single abstract property of adaptive model-free 
function estimation: Intelligent systems adaptively estimate continuous functions from data 
without specifying mathematically how outputs depend on inputs. Vie now elaborate this 

thesis. 

A function /, denoted / : X — Y, maps an input domain X to an output range Y. 
For every element x in the input domain X , the function f uniquely assigns the element 
y in the output range Y. We denote this unique assignments as y = /(x). /(x) = x 3 
defines a cubic function, /(x i, xj, X3) = (*t« xj, x, — x 3 ) defines a saddle 
hyperbolic-paraboloid vector function in physical or 3-dimensional space Pressure is 
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a function of temperature, mass of energy (e = m c 2 ), gravity of mass, erosion of gravity, 
consumption of income. Functions define causal hypotheses. Science and engineering paint 
our pictures of the universe with functions. 

Humans, animals, reptiles, amphibians, and others also estimate functions. We all re- 
spond to stimuli. We associate responses with stimuli. We associate actions with scenarios, 
class labels with patterns, effects with causes. Equivalently, we map stimuli to responses. 

Mathematically, all these systems transform inputs to outputs. The transformation 
defines the input-output function / : X -* Y . Indeed the transformation defines the 
system. We can operatively characterize any system— atomic, molecular, biological, eco- 
logical, economic or legal, geological, galactic— by how it transforms input quantities into 
output quantities. 

We call system behavior “intelligent" if the system emits appropriate, problem-solving 
responses when faced with problem stimuli. The system may use an associative memory 
embedded in the resistive network of an analog VLSI chip or embedded in the synaptic 
webs of its brain. Or the system may use a mathematical algorithm to search a decision 
tree, as in computer chess programs. 


Generalization and Creativity 

Intelligent systems also yenero/ize. Tbeir behavioral repertoires exceed their experience. 
Eightenth-century philosopher David Hume saw why: Intelligent systems associate similar 
responses with similar stimuli. Small input changes produce small output changes* Hence 
they estimate continuous functions. The pilot lands the airplane at night the same way 
if only a few of the runway lights are out or if the new runway differs only slightly from 
more familiar runways. The leopard stalks like prey in like ways in like circumstances. 
F-arh minnow in a school smoothly adjusts its swimming behavior to the position of its 
smoothly moving neighbors. 

Function continuity accounts for much novel or creative behavior, if not all of it. We call 
system behavior *noveT if the system emits appropriate responses when faced with new or 
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unexpected stimuli. “Novel ideas,” says bchaviorist psychologist B.F. Skinner [1953], are 
“responses never made before under the same circumstanccs....Novcl contingencies generate 
novel forms of behavior." Usually these new stimuli resemble known or learned stimuli, 

and our responses usually resemble known responses. 

Geometrically, wl.cn systems jeneral.se or -create" they n»p stimulus balls to response 
balls. Consider . known slimulus-response pair (x, y). Stimulus x defrnes a point m the 
stimulus space S, the set ot all possible stimuli for the problem at hand. In praetre. S 
often corresponds to the real Euclidean vector space JP. Response y defrnes a pomt m 

the response space R, which may correspond to R?. 

Now imagine a stimulus ball B x centered about stimulus x and a response ball B y 
centered about response y. All the stimuli * in B, resemble stimulus X. The closer 
stimulus x' is to stimulus X, and hence the smaller the distance d(x’,x), the more x" 

resembles x. The responses y' in By behave similarly. < 

Suppose y = /(x) for some unknown continuous function / : R? —> R?- The function 
/ defines the sampled system. Suppose further that / generates the response bail from 
the stimulus balk B y = /( B x ). So for every similar response y' in B y , we can find some 
similar stimulus rf in B x such that = /W Formally / maps the stimulus ball onto 

to the response ball. 

(We use the term “ball” loosely. Technically, /(Bx) need not define an open ball in RT. 
Thus we measure B y with a volume measure below in (29). The Ope" Mapping Theorem in 
real analysis [Rudin, 1974] implies that all bounded onto linear transformations / map the 
open ball B x to some set in R? that contains the open ball B y , where y = /(*)• At bcst 
we can only locally approximate most system transformations / as linear transformations.) 
Then we can measure the creativity C B ,(f) of system /, given the stimulus ball B x , 

by the volume ratio 


c B .U) 


V(By) 

" V(B X ) ’ 


(29) 


where the V operator (Lebesgue measure) measures ball volume in FT or R ?. Cb„ erode 
as it is, captures many intuitions. It also resembles a spectral transfer function. 


/ 
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Consider the extreme eases of infinite and zero creativity. For a fixed nondegenerate 
response ball B y , as the stimulus ball B x contracts to x, the creativity measure Ca,(/) 
increases to infinity. (The point x has zero volume.) Cb,(/) also increases to infinity if 
the stimulus ball is constant and nondegenerate but the response ball By expands without 
bound as its radius approaches infinity. In both cases an infinitely creative system emits 
infinitely many responses when presented with, in the first case, a vanishingly small number 
of stimuli or, in the second case, a fixed set of stimuli. 

Infinite creativity need not represent infinite problem solving. The reinforcing environ- 
ment selects “solutions* from our varied or creative responses. Most creative solutions arc 
impractical. We can emit creative responses without solving problems or contributing to 
our genetic fitness. Sometimes we call these responses “art” or “play.” 

At the other extreme, zero creativity occurs when the response ball B y vanishes or 
when the stimulus ball expands without bound as its radius grows to infinity. 4 In the first 
case the system / is a constant function. It maps all stimuli in B x to a single value y in 
Such an / is “dumb* or “dull.* In the second case, for an infinite-radius stimulus 
ball B x , the stimuli overwhelm the system’s response repertoire. Such systems resemble 
classical pattern-recognition devices that are sensitive only to well-defined, well-centered 
patterns (faces, rip codes, bar codes). 

Small variations in input provide the simplest novel stimuli. The physical or cultural 
environment may produce these variations. Or we may systematically produce them as 
grist for our analytical null. Wc may vary stimuli to solve a crossword puzzle, to fit physical 
variables to astronomical data, or to formulate and resolve a mathematical conjecture. 

Wc are all forward-looking creatures. We tend not to see the gradual causal chains that 
precede our every action, idea, and innovation. Even Beethoven’s Fifth Symphony appears 
less a discontinuity when we examine Becthoveen’s notebooks and a variety of preceding 
musical compositions by him and by other composers. 

Variation and selection drive biological and cultural evolution. Physical and cultural 
environments drive the selection process. Function continuity, and other factors, drive 
variation. 

Nature and man experiment with local variations of input parameters. This generates 



!<>cal variations of output parameters. Then selection processes filler the new outputs. 
More accurately, they filter the corresponding new systems. We call the new systems 
“winners" or “fit” if they pass through the selection filters, “losers" or “unfit" if they do 
not pass through. 

Variation and selection rates may vary, especially over long stretches of geological or 
cultural time. Different perturbed processes unfold at di(fe,cnt speeds. So some evolu- 
tionary stretches appear more “punctuated" than others [Gould, 1980). This means some 
measures of change — ultimately time derivatives — are nonlinear. It does not mean that 
the underlying input-output functions are discontinuous. 


Learning as Change 

i 

Intelligent systems also learn or adapt. They learn new associations, new patterns, new 
functional dependencies. They sample the flux of experience and encode new information. 
They compress or quantize the sampled flux into a small, but statistically representative, 
set of prototypes or exemplars. Sample data changes system parameters. 

“Learning" and “adaptation" are linguistic gifts from antiquity. They simply mean 
parameter change. The parameters may be numerical weights in an inner-product sum, 
average neurotransmitter release rates at synaptic junctions, or gene (allelle) frequencies 
at chromosonal loci in populations. 

“Learning" usually applies to synaptic changes in brains or nervous systems, coefficient 
changes in estimation or control algorithms or devices, or resistor changes in analog VLSI 
circuitry. Sometimes we synonymously apply “adaptation” to the same changing param- 
eters. In evolutionary theory “adaptation” applies to positive changes in gene frequencies 
[Wilson, 1975). 

In all cases learning means change. Formally, a system learns if and only if the system 
pamneter vector or matrix has a nonzero time derivative. In neural networks we usually 
represent the synaptic web by an adjacency or connection matrix M of numerical synaptic 
values. Then learning is any change in any synapse: 



( 30 ) 


M # O . 

Wc can learn well or learn badly. Dut we cannot learn without changing, and we cannot 
change without learning- 

Learning law, describe the synaptic dynmnical system, he. the system encodes m- 
formation. They determine how the synaptic-web process unfolds ,n ..me m the sysUm 
samples new information. This sh<* one way that neural networks compute w.th dynam- 
ical systems. Neural networks also identify neural activity with dynanucal systems. Th» 
allows the systems to decode information. 

In principle «c can harness any dynamical system to encode and decode some mforma- 

lion. We can view a kinetic swirl of molecules, a joint population of lynxes and rabbits, and 

a solar system as system, that tramform input states tn output states. In,.tal condthon, 
and perturbations encode ,ues.ions. Transit behavior computes answers. Bquthbrt- 
„m behavior prtwide. answers. In the extreme ease we can even vmw the umverse t - ■ » 
dynamical-system “computer." A godlike entity may choose Big-Bang initul conditio , 
and them me infinitely many, to encode certain information or to ask certmn <,uest.om. 
Tb. dynamical sy«em compubts as the univerm expands trmsientiy. UmmnJ eqmhbn- 
„m behavior could represent the computational output, a heat-death pattern or per ap, 

a periodic or chaotic oscillation of expansion and contraction. 

Consider mmri„ S a lawn of pee. pass. The — Wes' -be lawn the short-pass 
pattern. The lawn consist of a pamllel field of pass blades. Crass blades learn what they 
L cut. The law. behaves as a semipermanent, yet plastic, information storage mod, mm 

It tolerates faults and distributes cut patterns over large numbers of parallel un. Is. 

- i a wn and read or decode it from a rooftop. In principle we can 
can mow our name in the lawn, anu 

encode aU known iofornution in a sufficieotiy big lawn. Eventually the ia.n wti forget 
this information if we do not resample comparable data, if we do am re-mo. the lawn to 

^ ^Ulthmatefydearriing provides only a means to some computational end. Neural networks 
learn patterns or functions or probability distributions to reeopnz. future P*t«rns, 


156 


future inrut streams of data, or solve future combinatorial optimization problems. Fuzzy 
systems learn associative rules to estimate functions or control systems. We climb the 
ladder of learning and kick it away when we reach the roof of computation. We care how 
the learned parameter performs in some computational system, not how it was learned, 
just as we applaud the piano recital and not the practice sessions. 

Neural and fuzzy systems ultimately learn some unknown probability (subsethood) 
function p(x). The probability density function p(x) describes a distribution of vector 
patterns or signals x, a few of which the neural or fuzzy system samples. When a neural or 
fuzzy system estimates a function / : X Y, it in effect estimates the joint probability 
density p(x, y). Then solution points (x, /(x)) should reside in high-probability regions 
of the input-output product space A' x Y. 

We do not need to learn if we know p(x). We could proceed directly to our computa- 
tional task with techniques from numerical analysis, combinatorial optimization, calculus 
of variations, or any other mathematical discipline. The need to learn varies inversely with 
the quantity of information or knowledge. 

Sometimes the patterns cluster into exhaustive decision classes Di,..., Dt- The deci- 
sion classes may correspond to high-probability regions or “mountains.” (If the pattern 
vectors are two-dimensional, then p(x) defines a hilly surface in three-dimensional space 
/f\) Then class boundaries correspond to low-probability regions or “valleys” on the 

probability surface. 

Supervised learning uses class-membership information. Unsuperoised learning does 
not. An unsupervised learning system processes each sample x but does not “know” that 
x belongs to class 0. and not to class Dj. Unsupervised learning uses unlabelled samples. 
Neither supervised nor unsupervised learning systems assume knowledge of the underlying 
probability density function p(x). 

Suppose we want to train a speech-recognition system at an international airport. 
We want the German lightbulb to light up when someone speaks German to the speech- 
recognition system, the Hindi lightbulb to light up when someone speaks Hindi, and so on. 
The system learns as we feed it training waveforms or spectrograms. 

We supervise the learning if we label each training sample as German, Hindi, Japanese, 
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etc. We may do this to compute an error. If the English lightbuib lights up for a German 
sample, we may algorithmically punish the system for this misdassification. 

An unsupervised system learns only from the raw training samples. We do not indicate 
language class labels. Unsupervised systems adaptively cluster like patterns with like pat- 
terns. The speech-recognition system gradually clumps German speech patterns together. 

In competitive learning, for instance, the system learns class centroids, centers of pattern 

mass. 

Unsupervised learning may seem difficult and unreliable. But most learning is unsu- 
pervised, since we do not know accurately the labels of most sample data, especially in 
realtime processing. Every second our biological synapses learn without supervision on a 

single pass of noisy data. 

SYMBOLS VS. NUMBERS: RULES VS. PRINCIPLES 

We all share another property: We cannot articulate the mathematical rules that de- 
scribe, if not govern, our behavior. We can ask a violinist how she plays, and she can tell 
us. But her answer will not be a mathematical function. In general her answer will not 
enable us to reproduce her behavior. 

All lifeforms recognize vast numbers of patterns. The most primitive patterns relate to 
how an organism forages, avoids predators, and reproduces (Wilson, 1975). 

On this planet only man articulates rules, and he articulates very few. We articulate 
some rules in grammar, common law, and science (“physical laws”). Yet all our natural 
languages, living and dead, and all our systems of law have culturally evolved without 
conscious design and not in accord with articulated principles (Hayek, 1973). To some 
extent this also holds for our accumulated knowledge of medical, biological, and sodal 

science. 

There have been exceptions, and the exceptions have helped create the field of artificial 
intelligence. Last century linguists developed the articulated language Esperanto. Mathe- 
matician Giuseppe Peano similarly devised the language Interlingua. A few fans still learn 
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r , and Ute but far fewer spedi them ‘b“ *P“ k U ‘'"' * 

* nd !P “ k . hive created the many computer programming 

century computer scion is PMeal „d even Fortran, and infrequently 

guajes. Today programmers frequently use C, Pascal, 

use Algol and Jovial. around the computer 

„ . Enlists developed artificial intelligence in large part arou 

Computer d prolog> or /«*,«: programming. 

sitional and predicate calculi, underlies their P— structure 
Expert System Knowledge as Rule Trees 

A. systems store mid process proposidend^Tbe^ 

- * THEN B " 

consequents correspo A true, mtd the other put does not activate A. 

of the input space activates o , , . The rule A -> B local- 

Collections of * - - “ ^ Jcalt^ The Vuowfedge h~ 

, y structures the kno^edte rf A » The ^.^ion paths 

.ohany structures^, ru^ ^ ^ ^ ^ ^ „ .cedents W its U- 
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nudes or consequents. The term Wicdye _ rll ciy caU 

database. Because of the tree structure of now ’ which use feedbick and 

them tnotsiedj. frees. Chapter 4 di “"^“^“ oetwort s. 

vector-matrix operations to convey now^ ^ ^ ,ogical paths. Mb 

Knowledge engmeem sear Forward-chaining inference proceeds from 

enumeration defines the m/erenec proc . inference proceeds from 

Icnowledge-tiee antecedents to consequents. Bach For w.rd-chaimng 

consequents or ohse^tions to p^ihie an«edenU m ' 

inference answers »hat-if question. It derives ejects to ^ w 

ferenee answers why or hew-eome questions. It suggests causes ter obscr 


tei 



enumeration complexity increases nonlincarly with the number of rules storco. Realtime 
path enumeration in large knowledge trees may be combinatorial^ prohibitive, requiring 
heuristic or approximate search strategies (Pearl, 1984). 

Knowledge engineers acquire, store, and process the bivalent rules as symbols, not as 
numerical entities. This often allows knowledge engineers to rapidly acquire structured 
knowledge from experts and to efficiently process it. But it forces experts to articulate 
the propositional rules that approximate their expert behavior, and this they can rarely do. 

Symbolic vs. Numeric Processing 

Symbolic processing fits naturally in the brain-as-computer framework. Language 
strings model thoughts or shortterm memory. Rules and relations between language strings 
model longterm memory. Programming replaces learning. Logical inference replaces time 
evolution and nonlinear dynamics. Feedforward flow through knowledge trees replaces 
feedback equilibria. 

But we cannot take the derivative of a symbol. We require a sufficiently continuous 
function. Symbol processing precludes mathematical analysis in the traditional senses 
of engineering and the physical sciences. The symbolic framework allows us to quickly 
represent structured knowledge as rules, but prevents us from directly applying the tools of 
numerical mathematics and from directly implementing Al systems in large-scale integrated 

circuits. 

Figure 1.5 provides a taxonomy of model-free estimators. The taxonomy divides the 
knowledge type into structured (rule-like) and unstructured types and divides the frame- 
work into symbolic or numeric. All entries define model-free estimators because users need 
not state how outputs mathematically depend on inputs. 
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FIGURE 1.5 Taxonomy of model-free estimators. User need not state how 

system outputs explicitly depend on inputs. 

Figure 1-5 outlines the advantages and disadvantages of machine-intelligent systems. 
AI expert systems exploit structured knowledge, when knowledge engineers can acquire it, 
but store and process it outside the analytical and computational numerical framework. 

Neural networks exploit their numerical framework with theorems, efficient numerical 
algorithms, and analog and digital VLSI implementations. But neural networks cannot 
directly encode structured knowledge. They superimpose several input-output samples 
(x„ y.), (x 2 , yj), -, (x™, x„) on a black-box web of synapses. Unless we check all 
input-output cases, we do not know what the neural system has learned, and in general 
we do not know what it will forget when it superimposes new samples (x*. y*) atop the 
old. We cannot directly encode the commonsense traffic-light rule “If traffic is heavy in 
one direction, keep the light green longer in that direction.” Instead we must present 
the system with a sufficiently large set of input-output pairs, combinations of numerical 
traffic-density measurements and green-light duration measurements. 


AI EXPERT SYSTEMS 

FUZZY SYSTEMS 

— 

NEURAL SYSTEMS 
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Fuzzy Systems as Structured Numerical Estimators 

Fuzzy systems directly encode structured knowledge but in a numerical framework. We 
enter the fuzzy association (HEAVY, LONGER) as a single entry in a FAM-rule malnx. 
Each entry defines a fuzzy associative memory (FAM) “rule” or input-output transforma- 
tion. In Chapter 17 we discuss the fuzzy control of an inverted pendulum. F.gure 1.6 
shows a bank of FAM rules sufficient to control an inverted pendulum. 
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FIGURE 1.6 Bank of FAM rules to control an inverted pendulum. Each 
entry in the FAM matrix defines a fuzzy association between output fuzzy sets 
and p<urcd input fuzzy sets. 


AO, „d „ define toy variables. Fuss, amiable. * *»<• **«e lhe “*** 

variables. The angle fussy variable 0 measures the angle the pendulum shaft makes wit 
the vertical and ranges from -90 In 90. The angular velocity toy AO variable metres 
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U, c instantaneous rate of change ,( angle values. ... practice it measures the diKerenoe 

between successive angle values. Output (ussy va.id.le u uwasu.es the current « a "» 

controller that adjusts the pendulum sliaft. .. *, 

ft* fuzzy variable can assume five fuzzy-set values: Negative Medium (NM), Negative 

Small (NS,. Zee ,ZE). Positive Sma.1 ,PS,. and Positive Medium (PM,. The entry.. the 

center of the FAM mat... defines the steady-state FAM rule: IFF- 

= ZE THEN v = ZE ” . 

We usually def.no the (ussy-set values NM, .... PM as l..peso,ds o. triangles over 

regions o( the red line. For the (ussy angle variable «. we can define ZE as a narrow 

triangle centered at the se.o value in the iutcrvd ,-SO. « Then . ^^e angle vdue 0 bo 

longs to tbe (ussy set ZE to degree 1. The angle values 3 and -3 may be ong to ■ 

degree 0.6. Figure 1.7 shows seven trapesoidd (ussy-set values turned by (uss, ramble 0. 



FIGURE 1.7 Seven trapesoidal (ussy-set values assumed by (ussy variable 
0. Em* value o( 0 belongs to each (ussy set to some, but usudly sere, degree. 
The exact .due 3 belongs to the sero (ussy number ZE to degree 0.6, to t e 
positive smdt (uss, number PS to degree .3. and to positive, mod, urn PM 
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degree 0. 


Fuzzy systems allow users to articulate lingusilic FAM rules by entering values in a 
FAM matrix. Once a fuzzy engineer defines variables and fuzzy sets, the engineer can 

design a prototype fuzzy system in minutes. 

Chapter 17 shows that a large neural-type matrix encodes each FAM rule. When fuzzy 
variables assume fuzzy subsets of the real line, as when we define ZE as a triangle centered 
about 0, then these associative matrices have uncountably infinite dimension. This endows 
each FAM rule with rich structure and “memory capacity.” FAM systems do not add these 
matrices together, which avoids neural-type crosstalk. 

A virtual representation scheme allows us to exploit the coding and capacity proper- 
ties of these infinite matrices without actually writing them down. This holds for binary 
input-output FAMs (BIOFAMs), which includes all fuzzy systems used in commercial ap- 
plications. BIOFAMs accept nonfuzzy scalar inputs, such as 0 = 15 and A# = -10, 
and generate nonfuzzy scalar outputs, such as v = —3. 

Generating Fuzzy Rules With Product-Space Clustering 

Neural networks can adaptively generate the FAM rules in a fuzzy system. We illustrate 
this in Chapters 17-20 with the new technique of unsupervised product-space clustering. 
Synaptic vectors quantize the input-output space. Clustered synaptic vectors track how 
experts associate appropriate responses with input stimuli. Each synaptic duster estimates 
a FAM rule. The experts who generate the input-output data need not articulate the FAM 
rules. They need only behave as experts. The key geometric idea is duster equals rule. 

Consider the input-output product space of the inverted-pendulum system. There are 
two input variables and one output variable, so the input output product space equals Ft* 
(in practice a three-dimensional sub-cube within /?). Each input-output triple (0, A0, v) 
defines a point in if*. The time evolution of the inverted-pendulum system defines a 
smooth curve or trajectory in /l 3 . As the fuzzy system stabilizes the inverted pendulum 
to its vertical position, the trajectory may spiral into the origin of /£*, where the above 



steady-state FAM rule Veeps the system in equilibrium until perturbed. 

Each fuzzy variable can assume five fuzzy subsets of the z, y, or z coordinate axes of 
It 1 . The Cartesian product of these fuzzy subsets defines 125 (5x5x5) FAM cells in the 
input-output product space /£*. Most system trajectories pass through only a few FAM 
cells. We show in Chapter 17 that these FAM cells equal FAM rules because the FAM 
cells equal fuzzy cartesian products, and the uncountably infinite entries in the associative 
matrices correspond to these cartesian products. So FAM rule equals associative (fuzzy 
Hebb) matrix, which equals fuzzy cartesian product, which equals FAM cell. 

Unsupervised neural clustering algorithms efficiently track the density of input-output 
samples in FAM cells. We need only count the number of synaptic vectors in each FAM cell 
at any instant to estimate, and to weight, the underlying FAM rules used by the expert or 
physical process that generates the input-output data. This produces an adaptive histogram 
of FAM-cell occupation. Chapters 17 - 20 apply the adaptive product-space* clustering 
methodology to inverted-pendulum control, backing up a truck-and-trailer in a parking 
lot, and realtime target tracking. 

Suppose a system contains n fuzzy variables, and each fuzzy variable can assume m 
fuzzy-set values. This defines m“ FAM cells in the input-output product space if*. Differ- 
ent fuzzy variables can assume different types and different numbers of fuzzy-set variables. 
So in general there are m, X ... x m„ FAM cells. Suppose n = m = 3. Suppose 
the fuzzy sets are low, medium, and high and have bounded extent. Then a Rubik s cube 
represents the input-output product space partitioned into 27 FAM cells if the fuzzy sets 
do not overlap. In general FAM cells have nonempty but fuzzy intersection. 

If we define n fuzzy variables, each with m fuzzy-set values, then there are 2 possible 
fuzzy systems. Expert articulation, fuzzy engineering, and adaptive estimation produce 
only a small fraction of the total number 2 m " of possible fuzzy systems. Different fuzzy-set 
definitions and different encoding or decoding strategies (“inferencing" techniques) pro- 
duce different classes of 2*" possible fuzzy systems. 



Fuzzy Systems as Parallel Associators 

Fuzzy systems store and process FAM rules in parallel. Mathematically a fuzzy system 
maps points in an input product hypercube (possibly of infinite dimension) to points .n an 
output hypercube. Fuzzy systems associate output fuzzy sets with input fuzzy sets, and so 
behave as associative memories. Unlike neural associative memories, fuzzy systems do not 
sum the associative matrices that represent FAM rules. Neural network, sum throughputs. 
Fuzzy systems sum outputs . 

Summing outputs avoids crosstalk and achieves modularity. We can meaningfully look 
inside the black box of fuzzy model-free estimator. Figure 1.8 displays the generic fuzzy 
system architecture for a single-input, single-output FAM system. 



FIGURE 1.8 Fuzzy system architecture. The system maps input fuzzy 
sets A to output fuzzy sets B. The system stores separate FAM rules and in 
parallel fires each FAM rule to some degree for each input. Experts or adaptive 
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( algorithms determine the FAM-rulc weights to;. Experts may use only t o; = 1 

(articulates rule) or to,- = 0 (omits rule). Ccntroidal output converts fuzzy-set 
vector B to a scalar. In DIOFAM systems A defines a unit binary vector or 

delta pulse. 

Fuzzy inference computes thcoutput fuzzy sets B' jt weights them with the scalar weights 
wj, and sums them to produce the output fuzzy set B: 

B = I>i3 • ( 31 ) 

i 

In principle in (31) we sum over all m» possible FAM rules since most rules have weight 
Wi = 0. Chapter 17 discusses the mechanism of the two types of fuzzy inference, 

correlation-product and correlation-minimum inference. 

Adaptive fuzzy systems use sample data and neural or statistical algorithms to choose 
the coefficients to; and thus to define the fuzzy system at each time instant. Adaptation 
changes the system structure. Geometrically, a time-varying between-cube mapping defines 
an adaptive fuzzy system. In the simplest case, if the input fuzzy sets define points in the 
unit hypercube J\ and the output fuzzy sets define points in the unit hypercube I', then 
transformation S defines a fuzzy system if S maps J* to P, S : P ♦ P- Then S 
associates fuzzy subsets of the output space Y with fuzzy subsets of the input space X. 
So S(A) = B. S defines an adaptive fuzzy system if S changes with time: 

d l + O . t 32 ) 

dt T 

BIOFAM systems convert the vector B into a single scalar output value y € Y. We 
call this process defuzzification, although to defuzzify a fuzzy set formally means to round 
it off from some point in a unit hypercube to the nearest bit-vector vertex. Fuzzy engineers 
sometimes compute y as the mode y ^ of the B distribution, 

m fl (y m «x) = sup{m B (y): y € Y) . t 33 ) 

m B denotes the fuzzy membership function m B : Y * [0, l] that assigns fit values or 
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occurrence degrees to the elements of Y. If the output space Y equals a finite set of values 
{yi, • • • . y,}, *» in some computer discretizations, then we can replace the supreraum in 

(33) with a maximum: 


m B (y««) = max 


(34) 


The more popular centroidal defuzzification technique uses all, and only, the infor- 
mation in the fuzzy distribution B to compute y as the centroid y or center of mass of 

B: 


y 


/ oo 

y m fl (y) <ht 

-oo 

oo 

m B (y) dy 

•OO 


(35) 


provided the integrals exist. In practice we restrict fuzzy subsets to finite ftreUhes of 
the real line. In Chapter 19 we prove that if the fuzzy variables assume only symmetric 
trapezoid-like fuzzy-set values, then (35) reduces to a simple discrete ratio. The numerator 
and denominator contain only m products. This discrete centroid trivializes the computa- 
tional burden of defuzzification and admits direct VLSI implementation. 

Figure 1.8 and equation (31) additively combine the weighted fuzzy rets Bj. Earlier 
fuzzy systems [Mamdani, 1977) combined output fuzzy sets with pairwise maxima. Unfor- 
tunately, the maximum combination technique, 



B - max min(tPj, BJ-) , l 36 ' 

based upon the so-called “extension principle" of classical fuzzy theory IKlir, 1988), tends to 
produce a uniform distribution for B as the number of combined fuzzy sets increases (Kesko, 
1987). A uniform distribution always has the same mode and centroid. So, ironically, as 
the number of FAM rules increases, system sensitivity decreases. 

The additive combination technique (31) tends to invoke the fuzzy version of the Cen- 
tral Limit Theorem. The added fuzzy waveforms pile up to approximate a symmetric 
unimodal, or bell-shaped, membership function. Different fuzzy waveforms produce simi- 
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larly shaped output distributions B but centered about different places 01 the real line. We 
consistently observe this tendency towards a Gaussian membership function after summing 
only a few fuzzy waveforms. (Technically the CLT requires normalization by the square- 
root of the number of summed waveforms. Equation (31) docs not normalize B because, 
for defuzzification, we care only about the relative values in B, the relative degrees of 
occurrence of output values.) 

The maximum combination technique (36) forms the envelope of the weighted fuzzy 
sets Bj. Then B resembles the silhouette of a desert-full of sand dunes. As the number of 
sand dunes increases, the silhouette becomes flatter. The additive combination technique 
(31) piles the sand dunes atop one other to form a sand mountain. 

Fuzzy inference allows us to reason with sets as if they were propositions. The virtual- 
representation scheme for FAM rules greatly simplifies the fuzzy inference process if we use 
exact numerical inputs. Figure 1.9 illustrates the FAM (correlation-minimum) inference 
procedure derived in Chapter 17. We can apply this inference procedure in parallel to any 
number of FAM rules with any number of antecedent fuzzy-variable conditions. 
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FIGURE 1.9 FAM inference procedure. The fuzzy system converts the 
numerical inputs, 0 = 15 and A0 = -10, into the numerical output v = -3. 
Since the FAM rules combine the antecedent terms with AND, the smaller 
of the two fit values scales the output fuzzy set. If the FAM rules combined 
antecedents disjunctively with OR, the larger of the fit values would scale the 
output fuzzy set. 


Fuzzy Systems as Principle-Based Systems 

AI expert systems chain through rules. Inference proceeds down, or up, branches of 
a decision tree. Except for chess trees or other game trees, in practice these search trees 
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are wider than they arc deep. Shallow trees (or forests) can exaggerate the all-or-none 
effect of bivalent propositional rules. Relative to deeper trees, shallow trees use a smaller 
.proportion of their stored knowledge when they inference. They arc nonintcraclive. 

Fuzzy systems arc shallow but fully interactive. Every inference fires every FAM rule, 
itself a fuzzy expert system, to some degree. A similar property holds for the feedback 

fuzzy cognitive maps discussed in Chapter 4. 

Consider an Al judge and a fuzzy judge. Opposing counsel present the same evidence 
and testimony to both judges. The Al judge rounds off the truth value of every key 
statement or alleged fact to TRUE or FALSE (1 or 0), opens a rule book, uses the true 
statements to activate or choose the antecedents of some of the rules, then logically chains 
through the rule tree to reach a decision. A more sophisticated Al judge may chain through 
the rule tree with uncertainty-factor algorithms or heuristic search algorithms. 

The fuzzy judge weights the evidence to different degrees, say with fractional values in 
the unit interval (0, 1). The fuzzy judge docs not use a rule book. Instead the fuzzy judge 
determines to what degree the fuzzy evidence invokes a large set of vague legal principles. 
The fuzzy judge may cite case precedents to enunciate these principles or to illustrate their 
relative importance. The fuzzy judge reaches a decision by combining these fuzzy facts 
and fuzzy principles in an unseen act of intuition or judgement. If pressed, the fuzzy judge 
may defend or explain the decision by citing the salient facts and relevant legal principles, 
precedents, and perhaps rules. In general the fuzzy judge cannot articulate an exact legal 
audit trail of the decision process. 

The distinction between the Al judge and the fuzzy judge reduces to the distinction 
between roles and principles. Recently legal theorists (Dworkin, 1968-77; Hayek*, 1973] 
have focused on this distinction and challenged the earlier “positivist" legal theories of law 

as articulated rules [Kelsen, 1954; Hart, 1961]. 

Rules, as Dworkin (1977] says, apply “in an all-or-none fashion." Principles “have 
a dimension that rules do not— the dimension of weight or importance ’ and the court 
•dtes principles as its justification for adopting and applying a new rule." Rules greatly 
outnumber principles. Principles guide while rules specify: 
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“Only rules dictate results, come what may. When a contrary result has been 
reached, the rule has been abandoned or changed. Principles do not work that 
way; they incline a decision one way, though not conclusively, and they survive 
intact when they do not prevail." 

Rules tend to be black or white. They abruptly come into and out of existence. We 
post rules on signs, vote on them as propositions, and send them in memos: must be 18 
to vote, open from 8 am to 5 pm, $500 fine for littering, office term lasts four years, can 
take only five sick days a year, and so on. Rules come and go as culture evolves. 

Principles evolve as culture evolves. Most legal principles in the United States grew out 
of medeval British common law. Each year their character changes slightly, adaptively, 
as we apply them to novel circumstances. These principles range from very abstract 
principles, such as presumption of innocence or freedom of contract, to more behavioral 
principles, such as that no one can profit from a crime or you cannot challenge a contract 
if you acqt ,: ^se to it and act on it. 

E ach principle admits a spectrum of exceptions. In each case a principle holds only 
to some, often slight, degree. Judges cite case precedents in effect to estimate the current 
weight of principles. All the principles “hang together" to some degree in each decision, 
just as all the fuzzy rules (principles) in Figure 1.5 contribute to some degree to the final 
inference or decision. 

We often call AI expert systems rule-based systems because they consist of a bank 
or forest of propositional rules and an “inference engine" for chaining through the rules. 
The rule in rule-based emphasizes the articulated, expertly precise nature of the- stored 
knowledge. 

The AI precedent and modern legal theory suggest that we should call fuzzy systems 
principle-based systems. The fuzzy rules or principles indicate how entire clumps of 
output spaces associate with clumps of input spaces. Indeed FAM rules often behave as 
partial derivatives. Many applications require only a few FAM rules for smooth system 
control or estimation. In general AI rule-based systems would require vastly more precise 
rules to approximate the same system performance. 
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Adaptive fuzzy systems u.*c neural (or statistical) techniques to abstract fuzzy prin- 
ciples from sampled cases and to gradually refine those principles as the system samples 
new cases. The process resembles our everyday acquisition and refinement of cominouscnsc 
knowledge. Future machine-intelligent systems may match, then someday exceed, our a- 
bility to learn and apply the fuzzy commonsensc knowledge — knowledge we can articulate 
only rarely and inexactly— that we use to run our lives and run our world. 
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PROBLEMS 


1. Lukasiewicz’s continuous or “fuzzy” logic (Lj logic) uses a continuous- valued truth 
function i : S — ♦ [0, lj defined on the set S of statements. Lukasiewicz defined 
the generalized conjunction (AND), disjunction (OR), negation (NOT) operators 
respectively as 


l(A AND B) = min(t(A), t{B)) , 
l(AORi?) = max(t(/l), f(i?)) , 

*(NOT-A) = 1 - i(A) , 


for statements A and B - Prove the generalized noncontradiction-excluded- middle 
law: 


t(A AND - A) + i{A OR - A) = 1 . 

This equality implies that the classical bivalent law of noncontradiction, t(A AND ~ 
A) = 0, holds if and only if the classical bivalent law of excluded middle, t(A OR ~ 
A) = 1, holds. Note that in the caseof bivalent “paradox,” when t( A) = t(N0T-A), 
the equality reduces to the equality 1/2 + 1/2 = 1. 

2. Let t : S — ► [0, 1] be a continuous or “fuzzy” truth function on the set S 

of statements. Define the Lukasiewicz implication operator as the truth function 
*£,(A — > B) = min(l, I — 1(A) + t(B)) for statements A and B. Then prove the 
following generalized fuzzy modus ponens inference rule: 
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t L (A — . B) 


c 


t(A) > a 


i 

V 


Therefore t(B) > max(0, a «f c— I) . 


Hence if t(/l) = Il(A — ♦ B) = i, then t(B) = 1, which generalizes .classical 
bivalent modus ponens. 

3. Use the continuous logic operations in Problem 2 to prove the following generalized 
fuzzy modus iollens inference rule: 
tUA — > B) = c 
t(B) < b 


Therefore i(A) < min(l, 1 - c + b) . 


Hence if tt(A — * B) = 1 and t(B) — 0, then t(A) = 0, which generalizes 
classical bivalent modus Iollens. 

4. Define the Gaines implication operator as 

( min(l. t(B)/t(A)) if t(A) > 6 

1 if t(/l) = 0 . 

Use the Gaines implication operator tc{A B) to derive generalized fuzzy modus 

ponens and modus Iollens inference rules. The conclusion of the inference rules should 
differ from the conclusions of the inference rules in Problems 2 and 3. 

5. Exclusive-or ( XOR ) equals negated logically equivalence: 
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t(A XOR B) = I — l(A = D) . 


Equivalence equals biconditionality. Bivalent statements arc equivalent if and only 
if the two statements have the same truth values. So the cxdusivc-or relation holds 
between two bivalent statements if and only if the two statements have opposite 
truth values. 

Fuzzy statements can be equivalent to different degrees. But equivalence still equals 
biconditionality: 


l(A = B) = t((A — B) AND (B — * A)) . 

Prove that if we rise the Lukasiewicz implication operator, then exdusive-or equals 
the absolute difference (or l l or fuzzy Hamming distance) of the truth values t(A) 
and t(B): 


t L (A XOR B ) = |t(A) - <(f?)| . 


6. Set X contains n dements x», . . . , x„. So X contains 2" nonfuzzy subsets A. Define 
the bivalent indicator function I a of nonfuzzy set A as 


/x(x.) 


1 if x,- € A 
0 if Xi A 


So I a defines the mapping I a '• X — ♦ {0, 1}. 

Suppose we extend Ja to a multivalued mapping by augmenting its range from {0, 1} 
to where y t = 0, y m = 1, and 0 < yj < 1 if 1 < j < m. 

Then I A defines the mapping I A ■ X — ► {y u •••, y-}- How many multivalued 
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subsets docs X have? In the 2-dimcnsional case, A' = {z t , x*}, draw the planar 
lattice that describes the multi-dimensional power set of A', all its multi-dimensional 
subsets, when m = 3, and when m = 5. 

7. Consider the discrete dynamical system 


**+j = /(**) 

= C Xk (1 x k ) , 

for x values in (0, l) and 0 < c < 4. Many dynamical systems transition into 
chaos as we increase a control or gain parameter, such as c. Select c = 3.5 and use 
the two choices of initial conditions, xo = .5 and xq = .51, to generate X|, . . . ,Xjo- 
Plot the two trajectories on graph paper. Are they aperiodic (chaotic) or periodic? 
Does a difference of .01 in initial condition significantly affect the overall shape of 
the discrete trajectory? 

Now repeat the above experiment but use the gain parameter c = 3.9 (or c = 4). No 
matter how close two initial conditions, in a chaotic dynamical system they always 
produce divergent trajectories. Does c = 3.9 produce chaos? 
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CHAPTER 16 


FUZZINESS VERSUS PROBABILITY 


So far as the laws of mathematics refer to reality, they arc not certain. And so 
far as they an certain, they do not refer to reality. 

i 

. . . Albert Einstein 


( 


Fuzzy Sets and Systems 


We now explore fuzziness as an alternative to randomness for describing uncertainty. 
We develop the new sets-as-points geometric view of fuzzy sets. This view identifies a 
fuzzy set with a point in a unit hypercube, a nonfuzzy set with a vertex of the cube, and 
a fuzzy system as a mapping between hypercubes. Chapter 17 examines fuzzy systems. 

Paradoxes of two-valued logic and set theory, such as Russell’s paradox, correspond to 
the midpoint of the fuzzy cube. We geometrically answer the fundamental questions of 
fuzzy theory— How fuzzy is a fuzzy set? How much is one fuzzy set a subset of another?— 
with the Fuzzy Entropy Theorem and the Fuzzy Subsethood Theorem. 

We develop a new geometric proof of the Subsethood Theorem. A corollary shows that 
the apparently probabilistic relative frequency 7 * equals the deterministic subsethood 
S(X, A ), the degree to which the sample space X is contained in its subset A. So the 
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frequency of successful trials equals the degree to which all trials arc successful. We examine 
recent Bayesian polemics against fuzzy theory in light of the new sc ts-as- points theorems. 

An element belongs to a fuzzy set to some degree in (0, I). An element belongs to a 
nonfuzzy set all or none, 1 or 0. More fundamentally, one set is a subset of one of the set 
to some degree. Sets fuzzily contain subsets as well as elements. Subsethood generalizes 
elementhood. We shall argue that subsethood generalizes probability as well. 

Fuzziness in a Probabilistic World 

Is uncertainty the same as randomness? If we arc not sure about something, is it 
only up to chance? Do the notions of likelihood and probability exhaust our notions of 
uncertainty? 

Many people, trained in probability and statistics, believes-'. Some even say so, and say 
so loudly. These voices often arise from the Bayesian camp of statistics, where probabilists 
view probability not as a frequency or other objective testable quantity, but as a subjective 
state of knowledge. 

Bayesian physicist E. T. Jaynes (1979) says that ‘any method of inference in which 
we represent degrees of plausibility by real numbers, is necessarily either equivalent to 
Laplace’s {probability), or inconsistent." He claims physicist R. T. Cox (1946) has proven 
this as a theorem, a claim we examine below. 

More recently, Bayesian statistician Dennis Lindley (1987) issued an explicit challenge: 
“probability is the only sensible description of uncertainty and is adequate for all problems 
involving uncertainty. All other methods are inadequate. 

Lindley directs his challenge in large part at fuzzy theory, the theory that all things 
admit degrees, but admit them deterministically. We accept the probabilist’s challenge 
from the fuzzy viewpoint. We will defend fuzziness with new geometric first principles 
and will question the reasonableness and the axiomatic status of randomness. The new 
view is the sets-as-points view [Kosko, 1987] of fuzzy sets: A fuzzy set defines a point in a 
unit-hypercube, and a nonfuzzy set defines a corner of the hypcrcube. 







Randomness and fuzziness differ conceptually and theoretically. We can illustrate some 
differences will, examples. Others we can prove with theorems, as we show below. 

Randomness and fuzziness also share many similarities. Both systems describe unccr- 
tainty with numbers in the unit interval [0, lj. This ultimately means that both systems 
describe uncertainty numerically. Both systems combine sets and propositions associa- 
tive!^ commutatively, and distributive^. The key distinction concerns how the systems 
jointly treat a thing A and its opposite Classical set theory demands A D A‘ = 0, 
and probability theory conforms: P(A n A‘) = P(0) = 0. So ^ O A‘ represents a 


probabilistically impossible event. But fuzziness begins when A n A e # 0- 

Questions raise doubt, and doubt suggests room for change. So to commence the ex 
position, consider the following two questions, one fuzzy and the other probabilistic: 


(i) Is it always and everywhere true that .4 fl A e — 0 ? 

(ii) Do we derive or assume the conditional probability operator 


P(B\A) = 


P(A n B) , 
P(A) 


( 1 ) 


The second question may appear less fundamental than the first question, which asks 
whether fuzziness exists. The Entropy-Subsethoo-' Theorem below shows that the first 
question reduces to the second questions: We measure the fuzziness of fuzzy set A when 
we measure how much the superset A U i4 c is a subset of its own subset An/l'.a 
paradoxical relationship unique to fuzzy theory. In contrast, in probability theory the like 
relationship is impossible (has zero probability): P(A n A e \ A U A c ) = P{& PO = 0, 
where X denotes the sample space or “sure event*. 

The conditioning or subsethood in the second question lies at the heart of Bayesian 
probabilistic systems. We may accept the absence of a first-principles derivation of P(B\A). 
We can simply agree to take the ratio relationship as an axiom. But the new sets-as-points 
view of fuzzy sets derives its conditioning operator as a theorem from first principles. The 
history of science suggests that systems that hold theorems as axioms continue to evolve. 

The first question asks whether we can logically or factually violate the law of noncontra- 
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diction-one of Aristotle’s three “laws of thought” along with the laws of excluded middle, 
A U A e = A', and identity, A = A. Set fuzziness occurs when, and only when, it is 
violated. Classical logic and set theory assume that we cannot violate the law of noncon- 
tradiction or, equivalently, the law of excluded middle. This makes the classical theory 
black or white. Fuzziness begins where Western logic cnds-wherc contradictions begin. 


Randomness vs. Ambiguity: Whether vs. How Much 

Fuzziness describes event ambiguity. It measures the degree to which an event occurs, 
not whether it occurs. Randomness describes the uncertainty of event occurrence. An 
event occurs or not, and you can bet on it. The issue concerns the occurring event: Is it 
uncertain in any way? Can we unambiguously distinguish the event from its opposite? 

Whether an event occurs is “random”. To what degree it occurs is fuzzy. Whether an 
ambiguous event occurs-as when we say there is 20% chance of light rain tomorrow- 

involves compound uncertainties, the probability of a fuzzy event. 

We regularly apply probabilities to fuzzy events: small errors, satisfied customers, A 
students, safe investments, developing countries, noisy signals, spiking neurons, dying cells, 
charged particles, nimbus clouds, planetary atmospheres, galactic clusters. We understand 
that, at least around the edges, some satisfied customers can be somewhat unsatisfied, some 
A students might equally be B+ students, some stars are as much in a galactic cluster as out 
of it. Events can transition more or less smoothly to their opposites, making classification 
hard near the midpoint of the transition. But in theory-in formal descriptions and in 
textbooks-the events and their opposites are black and white. A hill is a mountain if it 
is at least x meters tall, not a mountain if it is one micron less than x in height [Quine, 
19811. Every molecule in the universe either is or is not a pencil molecule, even those that 
hover about the pencil’s surface. 

Consider some further examples. The probability that this chapter gels published is 
one thing. The degree to which it gets published is another. The chapter may be edited 
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in hundreds of ways. Or the essay may be marred with typographical errors, and so on. 

Question: Docs quantum mechanics deal with the probability that an unambiguous 
electron occupies spacetime points? Or docs it deal with the degree to which an electro,,, 
or an electron smear, occurs at spacetime points? Does |Vf dV measure the probability 
that a random-point electron occurs in infinitesimal volume dVl Or (Kosko, 1990] docs 
it measure the degree to which a deterministic electron cloud occurs in dVl Different 
interpretation, different universe. Perhaps even existence admits degrees at the quantum 

level. 

Suppose there is 50% chance that there is an apple in the refrigerator (electron in a 
cell). That is one state of affairs, perhaps arrived at through frequency calculations or a 
Bayesian state of knowledge. Now suppose there is half an apple in the refrigerator. That 
is another state of affairs. Both states of affairs are superficially equivalent in terms of 
their numerical uncertainty. Yet physically, ontologically, they differ. One is, “random", 

the other fuzzy. 

Consider parking your car in a parking lot with painted parking spaces. You can 
park in any space with some probability. Your car will totally occupy one space and 
totally unoccupy all other spaces. The probability number reflects a frequency history or 
Bayesian brain state that summarizes which parking space your car will totally occupy. 
Alternatively, you can park in every space to some degree. Your car will partially, and 
deterministically, occupy every space. In practice your car will occupy most spaces to 
zero degree. Finally, we can use numbers in (0, 1] to describe, for each parking space, the 
occurence probability of each degree of partial occupancy— probabilities of fuzzy events. 

If we assume events are unambiguous, as in balls-in-urns experiments, there is no set 
fuzziness. Only “randomness" remains. But when we discuss the physical universe, every 
assertion of event ambiguity or nonambiguity is an empirical hypothesis. We habitually 
overlook this when we apply probability theory Years of such oversight have entrenched 
the sentiment that uncertainty is randomness, and randomness alone. We systematical- 
ly assume away event ambiguity. We call the partially empty glass empty and call the 
small number zero. This silent assumption of universal nonambiguity resembles the pre- 
relativistic assumption of an uncurved universe. A 0 A e = 0 is the “parallel postulate 
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of classical set theory and logic, indeed of Western thought. 

If fuzziness is a genuine type of uncertainly, if fuzziness exists, the physical consequences 
arc universal, and the sociological consequence is startling: scientists, esjxxially physicists, 
have overlooked an entire mode of reality. 

Fuzziness is a type of deterministic jneertainty. Ambiguity is a property of physical 
phenomena. Unlike fuzziness, probability dissipates with increasing information. After the 
fact “randomness" looks like fiction. Yet many of the laws of science arc time reversible, 
invariant if we replace time i with time -t. If we run the universe in reverse as if it were a 
video tape, where does the “randomness" go? There is as much ambiguity after a sample- 
space experiment as before. Increasing information specifies the degrees of occurrence. 
Even if science had run its course and all the facts were in, a platypus would remain only 
roughly a mammal, a large hill only roughly a mountain, an oval squiggle only roughly an 

ellipse. Fuzziness does not require that God plays dice. , 

Consider the inexact oval in Figure 16.1. Docs it make more sense to say that the oval 
is probably an ellipse, or that it is a fuzzy ellipse? There seems nothing random about the 
matter. The situation is deterministic: All the facts are in. Yet uncertainty remains. The 
uncertainty arises from the simultaneous occurrence of two properties: to some extent the 
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Figure 16.1 Inexact-oval. Which statement better describes the situation: 
a Ii is probably an ellipse* or a It is a fuzzy ellipse ? 

More formally, does m A (x), the degree to which element i belongs to fuzzy set A, 
equal the probability that i belongs to A? Is m A (z) = Prob{x t A] true? Cardinality- 
wise, sample spaces cannot be too big. Else a positive measure cannot be both countably 
additive and finite, and thus in general cannot be a probability measure (Chung, 1974). 
The space of all possible oval figures is too big, since there are more of these than real 
numbers. Almost all sets are too big for us to define probability measures on them, yet we 
can always define fuzzy sets on them. 

Probability theory is a chapter in the book or finite measure theory. Many probabilists 
do not care for this classification, but they fall back upon it when defining terms (Kac, 
1959). How reasonable is it to believe that finite measure theory— ultimately, the summing 
of nonnegative numbers to unity-exhaustively describes the universe? Does it really 
describe any thing? 
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Surely from lime Co time every probabilist wonders whether probability describes any. 
thins real. From Demon, itns to Einstein, there has been the suspicion that, as Dav.d 

Hume |,74 8 | put it. -.ho„ 8 h there be no such thins - '■« *• »»*'• 

„t the real cause of any event has the same influence on the understmuhng and besets a 
like specie, of belief." When we model noisy processes b, extendins dilferential equatmns 
to stochastic diflcrcnlial equations, as in Chapters 4-6, we introduce the formalism only as 
a workins approximation to several underlying unspecified processes, processes that pre- 
sumably obey deterministic dilferential equations. In this sense eond.t.on.1 expeclalmns 
and martingale techniques might seem reasonably applied, for example, to stock opbons 
commodity futures phenomena, where the behavior involved cons.sU o aggregates of 
aggregates of aggregates. The same techniques seem less reasonably apphed to quarks, 

leptons, and void. 


The Universe as a Fuzzy Set 

The world, as Wittgenstein |1922) observed, is everything that is the case. In this 
spirit we can summarise the ontological case for fussiness: The universe consuU o * 
suhsets ./the universe. The only subseU of the universe that are not in prmc.pl. 
are the construeU of classical mathematics. The integer 2 belongs to the even mtegms, 
and does not belong to the odd or negative integers. All other sets seU of part., es.ee s, 
tissues, people, ideas, galaxies-in principle contain elemenU to d, Accent degrees, .e, 
membership is partial, graded, inexact, ambiguous, or uncertain. ' . „ 

The same universal circumstance holds at the level of logic and truth. The only logically 
true or false statemenU-statemenU 5 with truth value t(S) in (0, ,)-are tautologies 
theorems, and contradictions. If statement S describes the universe, if S - - 

statement, then 0 < «S) < 1 holds by the canons of scientific method and by Urn 

of a single demonstrated factual statement S w,th ,(S) = I or ,(S) = 0. Phdosop er 
Immanuel Kant |1787| wrote volumes in search of factually true logical statemenu and 

logically true factual statements. 
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Logical truth differs in kind from factual truth. “2 = 1 + 1" has truth value 1. “Grass 
is green" has truth value less than I but greater than 0. This produces the math/universe 
crisis Einstein laments in his quote at the beginning of this chapter. Scientists have im- 
posed a two-valued mathematics, shot through with logical “paradoxes” or antinomies 
[Kline, 1980], on a multivalued universe. Last century John Stuart Mill [1843] argued 
that logical truths represent limiting eases of factual truths. This accurately summarized 
the truth-value distinction between 0 < 1{S) < 1 and i(S) = 0 or l(S) = 1 but, 
cast in linguistic form, seems not to have persuaded modern philosophers. The Heisen- 
berg uncertainty principle, with its continuum of indeterminacy, forced multivaluedness 
on science, though few Western philosophers (Quine, 1981] have accepted multivalucd- 
ness. Lukasiewicz, Godcl, and Black [Rescher, 1969] did accept it and developed the first 

continuous or “fuzzy” logic and set systems* 

Fuzziness arises from the ambiguity or vagueness IBlack, 1937] between a taring * and 
its opposite A c . If we do not know A with certainty, we do not know A‘ with certainty 
either. Else by double negation we would know A with certainty. This ambiguity pro- 
duces nondegenerate overlap : A n A c ± 0, which breaks the “law of noncontradiction.” 
Equivalently, it also produces nondegenerate vnderlap [Kosko,1986b]: A U A e X , 

which breaks the “law of excluded middle." Here X denotes the ground set or universe of 
discourse. (Probabilistic or stochastic logics [Gaines, 1983] do not break these laws: P{A 
and not-*) = 0 and P{A or not-*) = 1.) Formally, probability measures cannot take 
fuzzy sets as arguments. We must first quantize, round off, or defuzzify the fuzzy sets to 
the nearest nonfuzzy sets. 

THE GEOMETRY OF FUZZY SETS: SETS AS POINTS 

It helps to see the geometry of fuzzy sets when we discuss fuzziness. To date researchers 
have overlooked this visualization. Instead they have interpreted fuzzy sets as generalized 
indicator or membership functions [Zadeh, 1965], mappings m A from domain A' to range 
(0, 1], But functions are hard to visualize. Fuzzy theorists (Klir, 1988] often picture 
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membership functions as two-dimensional graphs, with the domain A' represented a? a one- 
dimensional axis. The geometry of fuzzy sets involves both the domain X — {xi, . . . , x«] 
and the range (0, 1) of mappings m* : A' — * [0, l|. The geometry of fuzzy sets aids ns 
when we describe fuzziness, define fuzzy concepts, and prove fuzzy theorems. Visualizing 
this geometry may by itself provide the most powerful argument for fuzziness. 

An odd question reveals the geometry of fuzzy sets: What docs the fuzzy power set 
p(2 x ), the set of all fuzzy subsets of X , look like? It looks like a cube. What does a fuzzy 
set look like? A point in a cube. The set of all fuzzy subsets equals the unit hypercube 
/« _ ij" a fuzzy set is any point (Kosko, 1987] in the cube /". So (A, /") defines the 
fundamental measurable space of (finite) fuzzy theory. We can teach much of the theory 
of fuzzy sets— more accurately, the theory of continuous sets— on a Rubik’s cube. 

Vertices of the cube /" define nonfuzzy sets. So the ordinary power set 2*, the set of 
all 2 n nonfuzzy subsets of X, equals the Boolean n-cube B" : 2 X = B*. Fu^zy sets fill 

in the lattice B n to produce the solid cube /" : F(2 X ) = /". 

Consider the set of two elements X = {*i, zj}. The nonfuzzy power set 2 X contains 
four sets: 2 X = {0, X, {x,}, {u}}. These four sets correspond respectively to the four 
bit vectors (0 0), (1 1), (1 0), and (0 1). The Is and 0s indicate the presence or absence 
of the ith element *,• in the subset. More abstractly, we can uniquely define each subset A 
as one of the two- valued membership functions m A : X — * (0, 1). 

Now consider the fuzzy subsets of X. We can view the fuzzy subset A — (5 4) as 
one of the continuum-many continuous-valued membership functions m A : X ► [0, 1]. 
Indeed this corresponds to the classical Zadeh (1965] scts-as-functions definition of fuzzy 
sets. In this example element x\ belongs to, or fits in, subset A a little bit— to degree 5. 
Clement ij has more membership than not at j. Analogous to the bit vector representa- 
tion of finite (countable) sets, we say that the fit vector (I 2) represents A. The element 
mA ( x< ) equals the ith fit (Kosko, 1986b( or fuzzy unit value. The scts-as-points view then 
geometrically represents the fuzzy subset A as a point in P , the unit square, as in Figure 
16 . 2 . 
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Figure 16.2 Sets as points. The fuzzy subset A is a point in the unit 2 -cube 
with coordinates or fit values (§ *). The first element x, fits in or belongs to 
A to degree 5 , the element x 2 to degree §. The cube consists of all possible 
fuzzy subsets of two elements {x u x,}. The four corners represent the power 

set 2 X of {xj, xj}. 

The midpoint of the cube /" is maximally fuzzy. All its membership values equal 5 . 
The midpoint is unique in two respects. First, the midpoint is the only set A that not only 
equals its own opposite A c but equals its own overlap and underlap as well: 

A = A n A e = A U A e = A e . ( 2 ) 

Second, the midpoint is the only point in the cube /" equidistant to each of the 2 
vertices of the cube. The nearest comers are also the farthest. Figure 16.2 illustrates this 
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metrical relationship. 

We combine fuzzy sets pairwise with minimum, maximum, and order reversal, just as we 
combine nonfuzzy sets. So we combine set elements with the operators or Lukasiewicz con- 
tinuous logic {Reseller, 19691- We define fuzzy set intersection filwise by pairwise minimum 
(picking the smaller of the two elements), union by pairwise maximum, and complemen- 
tation by order reversal: 


rcixnB 

= min(m.4, me) , 

(3) 

rriAuB 

= max(mx, mg) , 

(4) 

rnA* 

= 1 - m A . 

(5) 


For example: 


A 

= 

(i 

.8 

.4 

.5) 

B 

r= 

(.9 

.4 

C 

-7) 

A n B 

= 

(•9 

.4 

0 

.5) 

A U B 

= 

(1 

.8 

.4 

•7) 

A c 

= 

(°. 

.2 

.6 

.5) 

A n A e 

- 

(0 

.2 

.4 

.5) 

A U A e 

= 

(1 

.8 

.6 

.5) 


The overlap fit vector A n A e in this example does not equal the vector of all zeroes, 
and the underlap fit vector A U A' does not equal the vector of all ones. This holds 
for all properly fuzzy sets, all points in J" other than vertex points. Indeed the min-max 
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definitions give at once the following fundamental characterization of fuzziness as nondc- 
gcncratc overlap and nonexhaustive undcrlap. 

Proposition. A is properly fuzzy iff A O A c 0 

iflT A U A e X . 

The proposition says that Aristotle’s laws of noncontradiction and excluded middle 
hold, but they hold only on a set of measure zero. They hold only at the 2" vertices of /". 
In all other cases, and these are as many of these as there are real numbers, contradictions 
occur to some degree. In this sense contradictions in generalized set theory and logic 
represent the rule and not the exception. Fuzzy cubes box Aristotelian sets into corners. 

Completing the fuzzy square illustrates this fundamental proposition. Consider again 
the two-dimensional fuzzy set A defined by the fit vector ( j j). We find the corresponding 
overlap and underlap sets by first finding the complement set A c and then combining the 
fit vectors pairwise with minimum and with maximum: 



A n A' = (i i) 

A U A c = (§ D . 

The sets-as-points view shows that these four points in the unit square hang -together, 
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and move together, in a very natural way. Consider the geometry of Figure 1G.3. 


(*2) = (0 1) 


xj 


1 

4 


0=( 0 0 ) 


AnA' 


AuA* 


A c 


X = (l 1) 


1 

3 


xi 


1 

3 


{Xi} = (l 0) 


Figure 16.3 Completing the fuzzy square. The fuzzier A is, the closer A 
is to the midpoint of the fuzzy cube. As A approaches the midpoint, all four 
points — A, A e , A n A c , and A U A e — contract to the midpoint. The less 
fuzzy A is, the closer A is to the nearest vertex. As A approaches the vertex, 
all four points spread out to the four vertices and the bivalent power set 2 X is 
recovered. In an n-dimensional fuzzy cube, the 2" fuzzy sets with elements a, 
or 1 — a,- similarly contract to the midpoint or expand to the 2" vertices as A 
approaches total fuzziness or total bivalence. 


In Figure 16.3 the four fuzzy sets involved in the fuzziness of set A — the sets A, A c , A O A e , 
and A U A c — contract to the midpoint as A becomes maximally fuzzy and expand out 
to the Boolean corners of the cube as A becomes minimally fuzzy. The same contraction 
and expansion occurs in n dimensions for the 2* fuzzy sets defined by all combinations 
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„t »,(.,) and «,(=,! •,(*.) »■><* Tl “ co " l, “ tion *" H ^ sim 

occra in n dimension* tor the 2" fosxy sets defined by alt combinations of m,M and 

m /4 c(i 1 ),...,m > 4(i«) and *»*«(*«•)• . 

At the midpoint nothing is distinguishable. At the .entices even-lhing is distinguish- 
able. These extremes represent the two ends ot the spectrum ot logic and set theory. In 
this sense the midpoint represents the black hole ot set theory. 

Paradox at the Midpoint 

The midpoint is full ot paradox. Classical logic and set theory forbid the midpoint br- 
ibe same axioms, noncontradiction and excluded middle, that generate the ot 
or antinomies ot bivalent systems. Where midpoint phenomena appear in Western thought, 
thoensts have invariably labeled them “paradoxes’ or denied them altogether. Mtdpoml 
phenomena include the halt-empty and half-full cup, the Taoist Yin- Yang, the bar from 
Crete who said that all Cretans are liars, Bertrand Russell's set ot all sets that are not 

members of themselves, and Russell’s barber. 

Russell’s barber is a bewhiskered man who lives in a town and who shaves. His barber 
shop sign says that he shaves a man it and only if he docs not shave himself. So who 
shaves the barber? If he shaves himself, then by definition he does not. But if he does 
not shave himself, then by definition he does. So he does and he does not-contradiction 
(■paradox’). Gaines [1983] observed that we can numerically interpret this paradoxical 

circumstance as follows. 

Let S be the proposition that the barber shaves himself and not-S that he does no;. 
Then since S implies not-S and not-S implies S, the two propositions are logically equ.v- 
alent: S = not-S. Equivalent propositions have the same truth values: 


t(S) = t( not-S) 

= 1 - t(S) 


( 6 ) 

(7) 
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Solving for 1{S) gives the midpoint point of the tnilli interval (l'ic onc-dimcnsior ;J cube 
(0, 1)): t(S) = k. The midpoint is equidistant to the vertices 0 and 1. In the bivalent 
(two-valued) ease, roundoff is impossible and paradox occurs. (6) and ( i ) describe the log- 
ical form of the many paradoxes, though different paradoxes involve different descriptions 

[Quine, 1987]. 

In bivalent logic both statements S and nol-S must have truth value zero or unity. 
The fuzzy resolution of the paradox uses only the fact that the truth values are equal. It 
does not constrain their range. The midpoint value f emerges from the structure of the 
problem and the order-reversing effect of negation. 

The paradoxes of classical set theory and logic illustrate the price we pay for an arbitrary 
insistence on bivalencc (Quine, 1981]. Scientists often insist on bi valence in the name of 
science. But in the end this insistence reduces to a mere cultural preference, a reflection 
of an educational predilection that goes back at least to Aristotle. Fuzziness shows that 
there are limits to logical certainty. We can no longer assert the lav.s of noncontradiction 
and excluded middle for sure — and for free. 

Fuzziness caries with it intellectual responsibility. We must explain how fuzziness fits 
in bivalent systems, or vice versa. The fuzzy theorist must explain why so many people 
have been in error for so long. We now have the machinery to offer an explanation: We 
round off. Rounding off, quantizing, simplifies life and often costs little. We agree to call 
empty the near empty cup, and present the large pulse and absent the small pulse. We 
round off points inside the fuzzy cube to the nearest vertex. This roundoff heuristic works 
fine as a first approximation to describing the universe until we get near the midpoint of 
the cube. We find these phenomena harder to roundoff. In the logically extreme case, at 
the midpoint of the cube, the procedure breaks down completely because every vertex is 
equally close. If we still insist on bivalence, we can only give up and declare paradox. 

Faced with midpoint phenomena, the fuzzy skeptic resembles the fiat-earther, who de- 
nies that the earth’s surface is curved, when she stands at the north pole, looks at her 
compass, and wants to go south. 
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Counting with Fuzzy Sets 


Ilo>v big is a fuzzy set? The size o, cardinality «f d. «M), «.«>•» *■ - *■ ni 

values of A: 

M(A) =£ <”a(*.) • (8) 

1=1 

The count of A = <|# H-b = 5 + ^ = »• " 

PM. 1983, call .he cardinality measure M .he U *"*? 

(I<osk „ 1986a] .he claaaical canting measure of combinatorics and measure theory. (So 
(X, /-! Jl/) defines the fundamental measure spac of fuzzy theory.) In general the measure 

M docs not yield integer values. 

The measure M has a natural geometric interpretation in the seU-as-pomts framevror . 
M(A) equals the magnitude of the vector drawn from the origin to the fuzzy set,. , as 

F igure 16.4 illustrates. 



Figure 16.4 The cunt M(d) of 4 equals the fuzzy Hamming norm (f nor- 
m) of the vector drawn from the origin to A. 


( 
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Consider the P distance between fuzzy sets A and 13 in /": 




l p (A, B) 



I’M*;) ~ 


”»o(*;)l'’ . 


( 9 ) 


where 1 < p < oo . The P distance is the physical Euclidean distance actually 

illustrated in the figures. The simplest distance is the /’ or fuzzy Hamming distance, 
the sum of the absolute fit differences. We shall use fuzzy Hamming distance throughout, 
though all results admit a general P formulation. Using the fuzzy Hamming distance we 
can rewrite the count M as the desired l l norm: 


M(A) 



i 

Y I’M*;) - °l 

I 

Y |”»x(*;) - *;)l 

t 


( 10 ) 

( 11 ) 

( 12 ) 

(13) 


THE FUZZY ENTROPY THEOREM 

How fuzzy is a fuzzy set? We measure fuzziness with by a fuzzy entropy measure. 
Entropy is a generic notion. It need not be probabilistic. Entropy measures the uncertainty 
of a system or message. A fuzzy set describes a type of system or message. Its uncertainty 
equals its fuzziness. 

The fuzzy entropy of A, E(A), varies from 0 to l on the unit hypercube /*. Only the 
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cube vertices have zero entropy, since non fuzzy sets arc unambiguous. The cube midpoint 
uniquely has unity or maximum entropy. Fuzzy entropy smoothly increases as a set point 
moves from any vertex to the midpoint. Khr (1988] discusses the algebraic requirements 
for fuzzy entropy measures. 

Simple geometric considerations lead to a ratio form for the fuzzy entropy [Kosko, 
1986b]. The closer the fuzzy set A is to the nearest vertex A ncar , the farther A is from the 
farthest vertex A { „ - The farthest vertex Aj„ resides opposite the long diagonal from the 
nearest vertex Ancar- Let a denote the distance l l (A, A nt , r ) to the nearest vertex, and let 
b denote the distance P{A, Aj„) to the farthest vertex. Then the fuzzy entropy equals 
the ratio of a to 6 : 


E(A) 



/'M, A^r) 
l'(A, A Jmr ) 


(14) 


Figure 16.5 shows the sets-as-points interpretation of the fuzzy entropy, where A - ( 55 ), 
A nea T = (0 1), and A,„ = (1 0). So o = £ + \ = £ and 6 = § + | = & So 

E[A) = Y7- 
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Figure 16.5 Fuzzy entropy, E(A) 
with distance to farthest vertex. 


balances distance to nearest vertex 


Alternatively, if you read this in a room, you can imagine the room as the unit cube 
/ 3 and your head as a fuzzy set in it. Once you locate the nearest corner of the room, the 
farthest corner resides opposite the long diagonal emanating from the nearest comer. If 
you put your head in a corner, then a = 0, and so E{A) = 0. If you put your head 
in the metrical center of the room, every comer is nearest and farthest. So a = 6, and 

£(A) = 1. 

Overlap and underlap characterize set fuzziness. So we can expect them to affect the 
measure of fuzziness. Figure 16.3 shows the connection. By symmetry, each of the four 
points A, A e , A n A e , and A U A e is equally close to its nearest vertex. The common 
distance equals a. Similarly, each point is equally far from its farthest vertex. The common 
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distance equals b. One of the first four distances is the count M(A fl A e ). One of the second 
four distances is the count M(A U /t e ). This gives a geometric proof of the Fuzzy Entropy 
Theorem (Kosko, 198Gb-87|, which stales that fuzziness consists of counted violations of 
the law of noncontradiction balanced with counted violations of the law of excluded middle. 


f\izzy Entropy Theorem: 


E(A) 


MjA n A c ) 
M(A U A e ) 


(15) 


An algebraic proof is straightforward. The completed fuzzy square in Figure 1G.G, contains 



Figure 16.6 Geometry of the Fuzzy Entropy Theorem. By symmetry each 
of the four points on the completed fuzzy square is equally close to its nearest 
vertex and equally far from its farthest vertex. 


The F uzzy Entropy Theorem explains why set fuzziness begins where Western logic 
ends. When sets (or propositions) obey the laws of noncontradiction and excluded middle, 




overlap is empty and undcrlap is exhaustive So M(A n A") = Hand M( A o A‘) - ». 
and thus E(A) = 0. 

The Fuzzy Entropy Theorem also provides a lira-principles derivaliou o( the basrc fuzzy 
set operations of minimum (intersection), maximum (union), and order reversal (comple- 
mentation) proposed in 1905 by Zadeb at the inception of fuzzy theory. (Lukasiewicz lirst 
proposed these operations for continuous o, fuzzy levies in the 1920s [Rcscher, 1909) ) 

For the fuzzy theorist, this result also shows that triangular norms or T-norms (Khr, 
,9881 which generalize conjunction or intersection, and the dud triangular conorms C. 
which generalize disjunction or union, do not have the (irst-principles status of m,n and 
max. For, the triangular-norm inequalities, 


T(x, y) < min(x, y) < max(x, y) < C(x, y) , (16) 

show that replacing min with any T in the numerator tm»«(« *‘) ■*» male ll “ 
numerator smaller, placing max with any C in the t««n Ml. A U A‘) can only nuke the 
denominator larger. So My T or C not identically min or max nukes the ratto smaller, 
strictly smaller if A is fuzzy. Then the entropy theorem does not hold, and the resullmg 
pseudrpentropy measure does not equd unity at the endpoint, though it continues to be 
r .. imi ..d there. We can see the with the product T-norm IPrade, 1985] T(i, ») - 

and its DeMorgan dual co-norm C(x, y) w 1 — T(1 — 1 y) - 1 + 9 ®y> 

or with the bounded sum T-norm T(*. V) = n“*(0.* + y - 1) and DeMorgan .dual 
C(x,y) = min(l, z+y). The Entropy Theorem similarly fails in general if the negatron or 

complementation operator W(z) = 1 - x with a parameterized operator M.(x) - 
for nonzero a > -1- 

All probability distributions, all sets A with M, A) = l,i»/"form.n-ld,mens>onal 
simplex S'. In the unit square the probability simplex equals the negatively slop*! dugonal 
line. In the unit 3-cube it equals a solid triangle. In the uniU-cube it equals a tetrahedron, 


and so on up. 

,f „„ probabilistic fit .due a satisfies A > l then the Fuzzy Entropy Theorem 
implies (Kosko, 19871 that the the distribution P has fuzzy entropy E(P) - Else 
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£(/>) < So the probability simplex S" is cutropically degenerate for large dimensions 

«. Tliis result also shows that the uniform distribution (± maximizes fuzzy entropy 

on S" but not uniquely. 'I'his in turn shows that fuzzy entropy differs from the average- 
information measure of probabilistic entropy, which the uniform distribution maximizes 

uniquely. 

The Fuzzy Entropy Theorem implies that, analogous to log j, a unit of fuzzy informa- 
tion equals or depending on whether the fit value / obeys / < 5 or / > 5. 

The event x can be ambiguous or clear. It is ambiguous if / equals approximately 5 
and clear if / equals approximately 1 or 0. If an ambiguous event occurs, is observed, is 

disambiguated, etc., then it is maximally informative: £(/) = £(5) = 1 - If a dear 

event occurs, is observed, etc., it is minimally informative: £(/) = £(0) = £(1) = 0. 

This agrees with the information interpretation of the probabilistic entropy measure log 
where the occurrence of a sure event (p = 1) is minimally informative (zero entropy) and 
the occurrence of an impossible event (p = 0) is maximally informative (infinite entropy). 

THE SUBSETHOOD THEOREM 

Sets contain subsets. A is a subset of £, denoted A C £, if and only if every element 
in A is an element of B. The power set 2 ® contains all of B’s subsets. So, alternatively 
(Bandler-Kohout, 1980 ], A is a subset of £ iff A belongs to B’s power set: 

A C B if and only if A G 2 s . * (^) 

The subset relation corresponds to the implication relation in logic. In classical logic 
truth maps the set of statements { S } to two truth values: l : {S} — ♦ ( 0 , l}- Consider 
the truth-tabular definition of implication for bivalent propositions P and Q: 
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0 0 
0 1 
1 0 
] 1 


— Q 


i 

i 

0 

1 


The implication is false if and only if the antecedent P is true and the consequent Q is 
false — when "truth implies falsehood.” 

The same holds for subsets. Representing sets as bivalent functions or "indicator” 
functions m A : X — ► {0, 1}, A is a subset of B iff there is no element i that belongs to 
A but not to B, or m A (x) = 1 but me(x) = 0. We can rewrite this membership-function 
definition as 

4 

ACS if and oniy if m A (x) < me(x) for all x . (18) 




Zadeh [1965] proposed the same relation for fuzzy set containment. We refer to this as 
the dominated membership function relationship. If A = (.3 0 .7) and B = (.4 .7 .9), 
then A is a fuzzy subset of B, but B is not a fuzzy subset of A. Either fuzzy set A is, or 
is not, a fuzzy subset of B. So the relation of fuzzy subsethood is not fuzzy. It is either 
black or white. 

The sets-as-points view asks a geometric question: What do all fuzzy subsets of B look 
like? What does the fuzzy power set of B — F( 2 s ), the set of all fuzzy subsets of B — look 
like? The dominated membership function relationship implies that F(2 B ) defines the 
hyper-rectangle snug against the origin in a unit hypercube with side lengths equal to the 
fit values m A (x t ). Figure 7 displays the fuzzy power set of the set B = (A |). F( 2 s ) 
has infinite count if B is not empty. For finite-dimensional sets, we can measure the size 
of F( 2 b ) (Kosko, 1987J as the Lebesgue measure or volume V(B), the product of the fit 
values: 
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(19) 


v(R) = n . 

<=i 



x= (I 1) 


{ XI } = ( 1 0) 


Figure 16.7 Fuzzy power set /(2 s ) as a hyper-rectangle in the fuzzy cube. 
Side lengths equal the fit values mg(x;). The size or volume of F(2 B ) equals 
the product Of the fit values. 


Figure 16.7 illustrates that /(2 s ) is not a fuzzy set. Either cube point A is or is not in 
the hyper-rectangle /’(2 s ). Different points A outside the hyper- rectangle /(2 s ) resemble 
subsets of B to different degrees. The bivalent definition of subsethood ignores this. 

The natural generalization defines fuzzy subsets F(2 B ): Some sets A belong to 
/(2 s ) to different degrees. Then the abstract membt.ohip function mp( 2 «)(/t) can equal 
any number in (0, 1]. This defines degrees of subsethood. 

Let S(>i, B) denote the degree to which A is a subset of B: 
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5(/t, B) = Degree (A C B) (20) 

= m F(i°)( / ') • ( 21 ) 

5(., .) denotes the subsethood measure. S(., .) lakes values in (0,1). We will see that it 
provides the fundamental, unifying structure in fuzzy theory. 

We want to measure S(A, B). We will first present an earlier [Kosko, 1986b-87j 
algebraic derivation of the subsethood measure S(A, B). We will then present a new, 
more fundamental, geometric derivation. 

We call the algebraic derivation the fit-violalion strategy. Intuitively we study a law by 
breaking it. Consider again the dominated membership function relationship: A C B if 
and only if m / |( i) < mg( i) for all x in X. 1 

Suppose element x* violates the dominated membership function relationship: m A ( x») 
> ms(x,). Then A is not a subset of B, at least not totally. Suppose further that the 
dominated membership inequality holds for all other elements x. Only element x„ violates 
the relationship. For instance, X may consist of one hundred values: X = {xj, — , i«o}. 
The violation might occur, say, with the first element: ii = x«. Then intuitively A is 
largely a subset of B. Suppose that X contains a thousand elements, or a trillion elements, 
and only the first element violates (18). Then it seems A is overwhelmingly a subset of B; 
perhaps S(A, B) = .999999999999. 

This example suggests we should count fit violations in magnitude and frequency. The 
greater the violations in magnitude, m> i(x„) - and the greater the number of 

violations relative to the size M(A) of A, the less A is a subset of B or, equivalently, the 
more A is a superset of B. For, both intuitively and by (18), supersethood and subsethood 
relate as additive opposites: 

SUPERS ETHOOD(i4, B) = 1 - S(A, B) . (22) 

We count violations by adding them. If we sum over all x, the summand should equal 
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m A ( i.) - m B (x.) when this difference is positive, and equal zero when it is nonpositivc. 
So *!ie summand equals max(0, - m H (x)). So the unnormalized count equals the 

sum of these maxima: 


^ max(0, m 4 ( 1 ) — »n B (x)). (23) 

xtX 

The count M(A) provides a simple, and appropriate, normalization factor. Bdow we 
formally arrive at M{A) by examining boundary eases in the geometric approach to sub- 
sethood. We can assume M{A) > 0, since M{A) = 0 if and only if A is empty. The 
empty set trivially satisfies the dominated membership function relationship (18). So it 
is a subset of every set. Normalization gives the minimal measure of nonsubsethood, of 
superset hood: 

yjnax( 0 , m A ( x) - m B (x)) i 

SUPERSETHOOD(A, B) = • ( 24 ) 

Then subsethood is the negation of this ratio. This gives the minimal fit-violation measure 
of subsethood: 


S{A , B) = 1 


y^niax( 0 , m A {x) — m B (x)) 

“ Wa) 


(25) 


The subsethood measure may appear ungraceful at first, but it behaves as it should. 
S(j 4 , B) = 1 if and only if (18) holds. For if (18) holds, (23) sums zero violations’. Then 
S(A, B) = 1 - 0 = 1. If S(A, B) = 1, every numerator summand equals zero. So 
no violation occurs. At the other extreme, S(A, B) = 0 if and only if B is the empty 
set. The empty set uniquely contains no proper subsets, fuzzy or nonfuzzy. Degrees of 
subsethood occur between these extremes: 0 < S(A, B) < 1. 

The subsethood measure relates to logical implication. Viewed at the 1 -dimensional 
level of fuzzy logic, and so ignoring the normalizing count ( M{A ) = 1 ), the subsethood 
measure reduces to the Lukasiewicz implication operator 
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S(A, to) - 1 - max(0, m A - mg) ( 2G ) 

= 1 - (1 - ini li (1 - 0, 1 - (m A - m B ))] (27) 

= min(l, 1 — m A + m B ) (28) 

= f £ (A — ♦ B) . (29) 


The min(.) operator in (28) clearly generalizes the above truth-tabular definition of biva- 
lent implication- 

Consider the fit vectors A = (.2 0 .4 .5) and to = (-7 .6 .3 .7). Neither 

set is a proper subset of the other. A is almost a subset of B but not quite since 
m A {x 3 ) - m„(x 3 ) = .4 - .3 = .1 > 0. Hence S(A , B) = 1 “ n = »- 
Similarly S(B, A) = 1 - g = g- 

Subsethood applies to nonfuzzy sets. Consider the sets C = {*i, *a, *3i*s» *r, x «, *io, 
i M ) and D = {*», is, x<, *$, *«» *s, *#> *ic, in, *i«} corresponding 

bit vectors 


' C = (1 1 1 0 1 0 1 0 l 1 0 1 0 1) 

D = (0 1 1 1 1 1 1 1 1 1 0 1 1 J ) - 


C and D are not subsets of each other. But C should very nearly be a subset of D since 
only x, violates (18). We find S(C, D) = 1 - | = f while S(D, C) = 1 - & * I* 
So Z? is more a subset of C than it is not. This holds because the two sets are largely 
equivalent. They have much overlap: M(C n D) = 8. This observation anticipates the 
Fuzzy Subsethood Theorem presented below. 
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W c now turn to a new «nd purely geometric derivutioti of the subselhood operator 
S(/t, 0). Consider the scls-as-points gcomcliy ot subselhood in Figure 10.7. Set /t is 
either in the hyper-rcctaoglc F(2 8 ) or not in it. Intuitively S(ri, 0) should npproanh 
unity ss A uppurachcs the toy power set F(2 8 ). S(A. 0) should doerrase, and the 
superselhood measure 1 - S(A, 0) should increase, as A mo.es from F(2 8 ). 

So the key Idra is metrical: How dose is A to F( 2»)7 Ut J(A,F(2‘» denote this 
0 distanee defined in (9). d(A, 0') denotes the distance between A and point B' in the 
hyper-rectangle, and B‘ C 0. Distanee d(A, F(2 8 )) equals the smallest such distance. 
Since the hyper-rectangle F( 2 s ) is closed and bounded (compact) and convex, some subset 
0- of 0 achieves this minimum distance. So the inlimum, the greatest lower bound, equals 

the distance d(/l, B m )' 


d(A,F(2 B )) = inf {</(>%, B ') : # e F(2 S )} (30) 

= d{A, B m ) . v 31 ) 


We can easily locate the closest set B‘ in the hypercube geometry. If A is a subset of 
B - if A is in the hyper-rectangle F(2 fl )-then A equals the closest subset: A = B\ So 
suppose A is not a proper subset of B. Then A lies outside the hyper-rectangle F(2 B ). * 
We cal slice the unit cube /" into 2" hyper-rectangles by extending the sides of F( 2 ) 
to hyperplanes. The hyperplanes intersect perpendicularly (orthogonally), at least in the 
Euclidean case. F(2 e ) defines one of the hyper-rectangles. The hyper- rectangle interiors 

correspond to the 2* cases whether m x (x.) < nia(*i) or > m e(*t) f° r ^ xetJ & 

and arbitrary A. The edges correspond to the loci of points where some 

The 2" hyper-rectangles classify as mixed or pure membership domination. In the pure 
case either m x < m B ,orm x > m B , holds in the hyper-rectangle interior for all x and all 
interior points A. In the mixed case m x (x.) < m B (x.) holds for some of the coord.nates 
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x„ and m »(*,•) > m B {xj) holds for the remaining coordinates x; in the interior for all 
interior A. So there arc only two pure membership-domination hyper-rectangles, the set 
of proper subsets F(2 e ) and the set of proper supersets, which includes X. 

Figure 1G.8 illustrates how the fuzzy power set F( 2 B ) of D = (5 §) linearly ex- 

tends to partition the unit square into 2 * rectangles. The non-subsets A u A 7 , and A 3 
reside in distinct quadrants. The northwest and southeast quadrants define the mixed 
membership-domination rectangles. The southwest and the northeast quadrants define 
the pure rectangles. 



3 


Figure 16.8 Partition of hypercube /* into 2 * hvper-rectangles by linear- 
ly extending the edges of F( 2 s ). We find the nearest points B\ and B; to 
points At and A 3 in the northwest and southeast quadrants by the normals 
from F( 2 b ) to A x and A 3 . The nearest point B' to point A 7 in the northeast 
quadrant is B itself. This “orthogonal" optimality condition allows d(A, B) by 
the general Pythagorean Theorem as the hypotenuse in an F “right* triangle. 




11 is the nearest set B' to A in the pure superset hyper-rectangle. To find the nearest 
set B’ in the mixed ease we draw a |>crpcndicular (orthogonal) line segment from A to 
F(2 fl ). Convexity of F{ 2 s ) is ultimately responsible. In Figure 1G.8 the perpendicular 
lines from A t and A 3 intersect line edges (1-dimensional linear subspaccs) of the rectangle 
F(2 S ). The line from A 7 to B, the corner of F(2 S ), is degenerately perpendicular since B 
is a zero-dimensional linear subspacc. 

These “orthogonality* conditions also hold in three dimensions. Let your room again 
be the unit 3-cube. Consider a large dictionary fit snugly against the floor corner cor- 
responding to the origin. Point B equals the dictionary corner farthest from the origin. 
Extending the three exposed faces of the dictionary partitions the room into 8 octants. The 
dictionary occupies one octant. We connect points in the other 7 octants to the nearest 
points on the dictionary by drawing lines, or tying strings, that perpendicularly intersect 
one the three exposed faces, or one of the three exposed edges, or the corner B. 

The “orthogonality" condition invokes the P-version of the Pythagorean Theorem. For 

our i l purposes: 


d(A, B) = d(A, B % ) + d(B , B-) . (32) 

The more familiar /’-version, actually pictured in Figure 16.8, requires squaring these 
distances. For the general P case: 

\\A-B\y = \\A~B-\r + p*-0ir . ’ * ( 33 ) 

or equivalently, 

t k - M* = t k - KT + t K - M’ • ( 34 > 

.=1 ■=! '=» 

Equality holds for all p > 1 sinoe, as is clear from Figure 16.8 or 16.10 and, in general, 

from the algebraic argument below, either 6* = a,- or 6j = 4,-. 

This Pythagorean equality is surprising. We have come to think of the Pythagorean 
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Theorem (and orthogonality) as an P or Hilbcrt-spacc property. Yet here it holds in every 
P spacc-if B' is the set in F( 2 fl ) closest to A in P distance. Of course for other sets 
strict inequality holds in general if # 2. This suggests a special status for the closest set 
B\ We shall see below that the Subsclhood Theorem confirms this suggestion. We shall 
use the term “orthogonality” loosely to refer to this P Pythagorean relationship, while 
remembering its customary restriction to 0 spaces and inner products. 

A natural interpretation defines supersethood as the distance d{A, F(2 S )) = d{A, B ). 
Supersethood increases with this distance; subselhood decreases with it. To keep superset- 
hood, and thus subsclhood, unit-interval valued, we must suitably normalize the distance. 

A constant provides the simplest normalization term for d{A, B'). That constant 
equals the maximum unit-cube distance, n* in the general l’ case and n in our 0 case. 
This gives the candidate subsclhood measure 


S(A, B) 


d(A F) 
n 


(35) 


This candidate subsethood measure fails in the boundary case when B is the empty 
set. For then d(A, B m ) = d(A, B) = M(A). So the measure in (35) gives S(A, 0) = 

! _ Midi > 0. Equality holds exactly when A = X. But the empty set has no subsets. 

Only normalization factor M(A) satisfies this boundary condition. Of course M{A) = n 
when A = X. Explicitly we require S( A, 0) = 0, as well as S(0, A) = 1, 

Normalizing by'n also treats all equidistant points the same. Consider points A, and Aj 
in Figure 16.9. Both points arc equidistant to their nearest F{2°) point: d(Aj, B,) = d(A 2 , Bj) 
. But A, is closer to B than A, is. In particular A, is closer to the horizontal line defined 
by the fit value m B (x i ) = |. The count M{ A) reflects this: M{A X ) > M(A 7 ). The count 
gap M(A X ) -M(A 3 ) arises from the fit gap involving x u and reflects d(A,, B) < d(A,. B). 

In general the count M(A) relates to this distance, as we can see by checking extreme cas- 
es of closeness of A to B (and drawing some diamond-shaped /* spheres centered at B). 
Indeed if m A > rn B everywhere, d(A, B) = M(A) - M(B). 
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Figure 16.9 Dependence of subsethood on the count M(A). A x and Aj 
are equidistant to F(2 B ) but A x is closer to B than Aj is; correspondingly, 
Af(Ai) > M(Aj). Loci of points A of constant count M{A) define line seg- 
ments parallel to the negatively sloping long diagonal. I 1 spheres centered at 
B are diamond shaped. 


Since ff(2 8 ) Sts snugly against the origin, the count M(A) in any ot the other 2" 1 

hyper-rectangles can be only larger than the count M(B') ot the nearest F(2 8 ) Thu 

normalisation choice ol n leaves the candidate subsethood measure indifferent to which of 
the 2* — 1 hyper-rectangles contains A and to where A resides is in the hyper rectang 
Each point in each hyper-rectangle involves a different combination of fft-violations and 
satisfactions. The normalisation choice ot M(A) reSccts this St-violatioo structure and 
behaves appropriately in boundary cases. 
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The normalization choice M(A) leads to the subsethood 


measure 


5(/l, B) 


djA in 

M(A) 


(3G) 


We now show that this measure equals the subsethood measure (25) derived algebraically 
above. 

Let B' be any subset of B. Then by definition the nearest subset * obeys the inequal- 


ity: 



|a. - t*|” < 


where for convenience a, = m^(xi), and 6, 


IK 



ms(x,). We will assume p 


(37) 
1 but the 


following characterization of &■ holds for any p > 1- 

“Orthogonality” implies a,- > 6*. So first suppose a,- = 6-. This equality holds if and 

only if no violation occurs: a; < fc. (If this condition holds for all then A = B\) So 
max(0, at-bi) = 0. Next suppose c, > 6*. This inequality holds if and only if a violation 
occurs:’ a.- > fc. (If this holds for aU *, then B = B*.) Sob’ = b; since B’ is the subset 
of B nearest to A. Equivalently, a, > b { holds if and only if max(0, o,- - 6;) = a; - 
The two cases together prove that max(0, a,- - &,) = ! <*,• - J?|. Summing over all x,- 

gives 


d(A, B’) = £max(0, m A (xi) - m B {xi)) • C 38 ) 

f=l 

So the two subsethood measures (25) and (36) are equivalent. 

This proof also proves a deeper characterization of the optimal subset B : 


B‘ = A n B . ( 39 ) 

For if a violation occurs, then a,- > 5,, and i,- = b { . So min(c,-, 6.) — b { . Otherwise 
a, = b’ it and so min(a,-, 6.) = 6*. So B" = A n B. 
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This i„ turn proves that B- is a point of double optimality. O' » both the subset o( B 
nearest A, and A\ the subset of A nearest to D : 

d(B, F{2 a )) = d(B, >4*) = d(B , B‘) • ( 40 ) 

Figure 16.10 illustrates that B' = A n D = A' ideutiBes the set vdthm both llte 
hyper-rectangle F(2') and the hyper-reetaugle F(2») that has maximal count M(A n B). 


{ xj } = ( 0 1) 



X= (1 1) 


0=(O 0) 


{xil = d 0) 


Figure 16.10. B* as both the subset of B nearest A and the subset A~ of A n- 
earest B : B m = A’ = An B. The distance d(.4, B m ) = A/(.4) - M(A n B) 
illustrates the Subsethood Theorem. 


Figure 16.10 also shorn that the distance d{A, B') equals a vector magnitude differ- 
ence HA, B') = M(A) - M(A n B). Dividiog both sides ot this equality by 
AHA) and ^arranging proves a still deeper structural characterisation of subsethood, the 

Subsethood Theorem. 
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M(A n D) 

SubscthoodThcorcm. S(A, B) - 
T|,c Subscthood Theorem immediately implies a Bayes Theorem: 


( 41 ) 


Subscthood Theorem. 


S{A , B) 


MjB) S(BjA) 
M{A) 


(42) 


since (41) implies M(A n B) = M{B) S(B,A). 

The ratio form of the subsethood measure S(A, B) has the same ratio form as the 

conditional probability P(B|ri) has in (1). We deriaed the ratio form for the sobsethood 
measure S(A B ) but assumed it for the conditional probability P(B\A). Since every 
probability is a crmditional probability, P(A) = P(A|X), this suggests we can reduce 

probability to subsethood. We shall argue that this reduction holds both frequenbst or 
“objective* probability and axiomatic or Bayesian or “subjective* Probability. 

Consider the physical interpretation of randomness as the relative frequency »„/». =ts 
denotes the number of successes that occur in n trials. Historically probabilbts have called 
the success ratio ( or its limit) nu/n the -probability of success" or P(d)- We can now 
derive the relativcfrequency definition of probrirility as S(X. A), the degree to whrch a 
bivalent superset X, the sample space, is a subset of its own subset A. The con'cept of 
■randomness* never enters the deterministic set-theoretic framework. This holds equ y 
for flipping coins, drawing balls from urns, or computing Einstein-Bose statistics. 

Suppose A is a nonfuzzy subset of X. Then 


Af(A n X ) 

S(X,A) - M 


(43) 
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MM) 

M(A') 


( 44 ) 


2d 

n 


( 45 ) 


The „ elements of X constitute the de /.cl. universe of discourse of the -expenment. 
(We can take the limit of the ratio S(X, .4) if it mathematically mate sense to do so 
IKac 1959].) The -probability” “ has reduced to a desree of subsethood, a purely fussy 
set-theoretical relationship. Perhaps if, ermturies ago, scientists had developed set theory 
before the, formalised gambling, the undefined notion of -randomness” ought never have 

culturally prevailed, if even survived, in the age of modern science. 

The measure of overlap Af(A ft X) provides the key component of relatrvc frequency. 
This count does not involve -randomness" . Af< A fl X) counts which elements are . dent, cal 
or similar. The phenomena themselves are deterministic and black or white. The same 
situation gives the same number. V/e may use the number to place bets or to swrie a 
phone line, but it remains part of the description of a specific state of aifarrs. We need no 
invoke an undefined “randomness” to further describe the situation. 

Subsethood subsumes elementbood. We can interpret the membemhrp degree main) 
as the subsethood degree S({*.-}. A), -hem <*} denotes a singleton subset or “elemen- 
t” of X. <*) corresponds to a bit vector with a 1 in the rth slot and Os elsewhere. 

{„} = (0 0,1,0 0). It we view A as the fit vector (u, «J. 1 “ 

(*.} n A = (0 0,.r,0 0), the rth coordinate projection. Since the count M( {*,')) 

equals one, the Subsethood Theorem gives 


S({*,), A) 


M({x,-} n A) 
M({*;}) 

M( (0,. . - * • -» 0) ) 


= Oi 


( 46 ) 

( 47 ) 


( 48 ) 



= m A {xi) 


( 49 ) 


= Dcgrcc(r, G A) • 

So subscthood reduces to clcmcnthood if antecedent sets arc bivalent singleton sets. 

The subscthood orthogonality conditions project A onto the facing side of the hyper- 
rectangle F( 2 s ). This projection gives the “normal equations” of least-squares parameter 
estimation (Sorenson, 1980], a version of which we saw in Chapter 5. In general for two 
Hr vectors x and y, we project x onto y to give the projection vector p = c y. The 
difference x - p is orthogonal to y : (x - p) 1 y. So 


0 = (x - p)y T 

(51) 

= (x - cy)y T 

(52) 

T T 

= xy - cyy , 

(53) 

where column vector y T denotes the transpose of row vector y. 
coefficient c as the familiar normal equations: 

(53) gives the projection 

x y T 

c ~ yy T 

(54) 

Y. *iVi 

(55) 

is I 

is 1 



Consider the unit square in Figure 16.10 with the same A, say A = (; 5 ). But 
suppose we shift B directly to the left to B = (0 |). This contracts the rectangle F[ 2 B ) to 
the line segment (0 §] along the vertical axis. These assumptions simplify the correlation 
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mathematics yet still preserve the least-squares structure. We expect that B cB , 
or c jj = /| n /), when we project A onto F( 2 fl ) or, equivalently in this special ease, 
when we project A onto B. The intersection A n D equals the minimum fit vector (0 1), 
AB t = 0 + | = A, and BD t = 0 + (§) J = Then 

_ A&_ 

C ~ BB 7 

1 

_ 5 . 

“ 4 

9 



and 


BT = cB 


- i<° i> 


= (0 ;) 


= A n B 


as expected. More generally if B = (&i 6i — 0, 6j > 0, and aj < bj, then 


A B T _ Qi^t + 

C = B B T ~ 6? + 6§ 

_ a 7 bj 


( 56 ) 

( 57 ) 
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Then c D = (0 *&■) = (0 a 7 ) = A n 13 since a 2 < l>j. 

Subsethood has extended the Pythagorean Theorem, relative frequency, and element- 
hood, and involves the normal equations or lcast-square estimation. We shall now see how 
subsethood relates to axiomatic or Bayesian probability and to fuzzy entropy. 


Bayesian Polemics 


Bayesian probabilists interpret probability as a subjective stale of knowledge. In prac- 
tice they use relative frequencies (subsethood degrees) but only to approximate these s- 

tates of knowledge." , 

Bayesianism is often a polemical doctrine. Some Bayesians claim that they, and only 

they, use all and only the available uncertainty information in the description of uncertain 
phenomena. This stems from the Bayes Theorem expansion of the “a posteriori" condi- 
tional probability P{Hi\E), the probability that Hi, the tth of fc-many disjoint hypotheses 
{Hi), is true given observed evidence E: 


P(H\E) 


P{E n Hi) 
P(E) 


(59) 


P(E \H{) P(Hj) 
P(E ) 


(60) 


P(E\Hj) PjHi) 
E P(E\Hi) P(Hj) 


(61) 


since the hypotheses partition the sample space X : U H 2 U ... U H k - X and 

Hi nHj = O if i j. 


The Bayesian approach uses all available information in computing the posterior dis- 
tribution P(//,|C) by using the “a priori’ or prior distribution /■’(//,) of the hypotlicscs. 
The Bayesian approach stems from the ratio form of the conditional probability measure. 

The Subsethood Theorem trivially implies Bayes Theorem when the hypotheses {//;} 
and evidence E arc nonfuzzy subsets. More important, the Subsethood Theorem implies 
the Fuzzy Bayes Theorem in the more interesting ease when the observed data E is fuzzy: 




SjHi, E) M(fk) 
E S(H it E) M^) 

i- i 

sm e) u 
E sm E)fi 

j = i 


(62) 


(63) 


where /,- = = S(A", //,) gives the “relative frequency” of the degree 

to which all the hypotheses are Hi. 

The Subsethood Theorem implies inequality when the partitioning hypotheses are 
fuzzy. For instance, if k = 2, H c is the complement of an arbitrary fuzzy set H, 
and evidence E is fuzzy, then (Koslco, 1986b] the occurrence of nondegenerate hypothesis 
overlap and underlap gives a lower bound on the posterior subsethood: 


S(E , H) > 


S(H t E) f H 


(64) 


S(H, E ) J„ + S(H C , E)f„< ’ 

where }n = S(A', H). The lower bound increases with M(H) and decreases with M{H e ). 
Since a like lower bound holds for S(E, // e ), adding the two posterior subsethoods gives 
the additive inequality 


S(£, H ) + S{E , H e ) > 1 , ( 65 ) 

an inequality Zadeh (1983] arrived at independently by directly defining a “relative sigma- 
count" as the subsethood measure given by the Subsethood Theorem. If H is nonfuzzy. 
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equality holds as in the additive law of conditional probability: 


P(H\E) + P(H e \B) = 1 • (“) 

The Subsclhood Theorem implies a deeper Bayes theorem for arbitrary fuzzy sets, the 
Odds-Form Fuzzy Bayes Theorem: 

5(i4i O H, At) 5(i4? O //, Ai) S(H, A 2 ) (g7) 

S(At O H , A|) ~ S(A\ n H , Ai) S(H, A e 2 ) 


We prove this theorem directly by replacing the subsclhood terms on the righthand side 
with their equivalent ratios of counts, canceling like terms three times, multiplying by 
MM. nw) f rearranging, and applying the Subsclhood Theorem a second time. 

We have now developed enough fuzzy theory to examine critically the recent anti- 
fuzzy polemics of Lindley [1987J and Jaynes [1979) (and thus Cheeseman [1985] who uses 
Jaynes’ arguments). To begin we observe four more corollaries of the Subsethood Theorem: 


(i) 0 <, S(H , A) < 1, 

(it) S(H , A) = 1 if H C A, (69) 

(Hi) S(H, At U A,) = S(tf, A,) + S(H, A 7 ) - S(H,A t n A,) ,(70) 

(i„) S(H, At n A,) = S(H y At) S(A| P. H , A,). (71) 

Each relationship follows from the ratio form of S( A, B). The third relationship (70) uses 

the additivity of the count A/(A), which follows from min(z,y) + max(x, y) = x + y. 

Suppose we make the notational identification S(H , A) = P(A\H). We then obtain 
the defining relationships of conditional probability Lindley proposed: 
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Convexity : 0 < P{A\ll) < 1 and P(A\II) = 1 if // implies A, (72) 

Addition : P(Ai U A 2 \U) = P(A\\H) + P{Aj\II) — P(Ai fl Ai\H)[13) 

Multiplication : P{Ai n Ai\li) = P{A\\li) P(A 2 \A\ fl H). (74) 

“From these three rules,” Lindlcy tells us, “all of the many, rich and wonderful results 
of the probability calculus follow. They may be described as the axioms of probability.” 
Lindlcy takes these as “unassailable" axioms: u Wc really have no choice about the rules 
governing our measurement of uncertainty: they are dictated to us by the inexorable laws 
of logic.” Lindlcy proceeds to build a “coherence” argument around the Odds-Form Bayes 
Theorem, which he correctly deduces from the axioms as the equality 

P{A t \Ai nH) P(At\Ai n H) P(A 2 \H) . 

PiA^At n H) P(A t \Al fl H ) P{A\\H) ’ V J 

where here we interpret A e as not-A. “Any other procedure," Lindley claims, “is inco- 
herent.” This polemic evaporates in the face of the above four subsethood corollaries and 
the Odds-Form Fuzzy Bayes Theorem. Ironically, rather than establish the primacy of 
axiomatic probability, Lindley seems to argue that it is fuzziness in disguise. 

Maximum-entropy estimation provides another source of Bayesian probability polemic 
(Cheescman, 1985]. Here the axiomatic argument rests on the so-called Cox’s Theorem 
(1946). 

According to physicist E.T. Jaynes (1979]: “Cox proved that any method of inference in 
which we represent degrees of plausibility by real numbers, is necessarily either equivalent 
to Laplace’s, or inconsistent,” where Jaynes cites Laplace as an early Bayesian probabilist. 
In fact Cox used bivalent logic (Boolean algebra) and other assumptions to show that, 
again according to Jaynes, the “conditions of consistency can be be stated in the form of 
functional equations," namely the probabilistic product and sum rules: 
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P{A n B\C) = 

P{A\B n C) P(B\C) , 

(7G) 

P(B\A) + 

P(B C \A) = 1 . 

(77) 


The Subsethood Theorem implies 


S(C,A n B) = 

S{B n C,A) 5(C, B) , 

(78) 

S(A, B) + 

S(A , B c ) > 1 , 

(79) 


with, as we have seen, equality holding for the second subsethood relationship when B is 
nonfuzzy, which holds in the Cox-Jaynes setting. 

In the probabilistic case overlap and underlap are degenerate. So ,P( A ft A e |B) = P{0\B) 
= |gl — 0, and P(B\ A n A e ) = P(B\0) is undefined. Yet in general S(B, AflA e ) > 0, 
and we can define S(A n A e , B) when A and B are fuzzy or nonfuj 

Jaynes’ claim is either false or concedes that probability is a special case of fuzziness. 
For strictly speaking, since the subsethood measure S(A, B) satisfies the multiplicative 
and additive laws specified by Cox and yet differs from the conditional probability P(B\A), 
Jaynes’ claim is false. 

Presumably Jaynes was unaware of fuzzy sets. He suggests that the frequency theory of 
probability provides the only alternative uncertainty theory, and we have reduced relative 
frequency to the subsethood measure S( X, A). So if we restrict consideration to nonfuzzy 
sets A and B , equality holds in the above subsethood relations, and Jaynes argues correctly: 
probability and fuzziness coincide. But fuzziness exists, indeed abounds, outside this 
restriction and classical probability theory do is not. So fuzzy theory extends probability 
theory. Equivalently, probability represents a special case of fuzziness. 
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When we examine Cox’s actual arguments, we liml that Cox assumes that the uncer- 
tainty combination operators am continuously twice ditfcmnlieMe. Min and max are not 
twice differentiable. Technically, Cox's theorem docs not apply. 

the entropy-subsethood theorem 

We independently derived the Futsy Entropy Theorem and the Subselhood Theorem 
from first principles, from sets-as-points unil-cnbe jcomelry. Both theorems involve ratios 

of cardinalities. So we can suspect a connection. 

The Entropy-Subsethood Theorem shows that the connection involves overlap A n A' 
and underlap A U A'. The theorem eliminates fuzzy entropy in favor of subselhood. 
So subselhood emerges as the fundamental, characterizing quantity of fuzziness-and, ar- 
guably, of probability as well. 


Entropy-Subsethood Theorem: E(A) - S(A U AS A n A ) . (80) 


The theorem follows if we replace Sandlin the Subselhood Theorem with respectively 
overlap Ar\A e and underlap A U A'. Since overlap is a subset of underlap, since 
S{A n AS A U A e ) = 1 , the intersection of the two sets equals the overlap. 

The Entropy-Subsethood Theorem describes a peculiar relationship. It gives fuzziness 
or ambiguity as the degree to which the superset A U A* is a subset of its own subset 
A n AS the extent to which the whole is a part of one of its own parts, a relationship 

Western logic forbids. 

This relationship violates our ingrained Venn-diagram intuitions of unambiguous set 
inclusion. Only the midpoint of /" yields total containment of underlap in overlap. The 
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cube vertices yield zero containment. This parallels in the extreme the relative frequency 
relationship S(X, A) = where noufuzzy subset A contains to some degree its nonfuzzy 

superset X • 

Figure 16.11 illustrates the Enlropy-Subsclhood Theorem. It shows that d\ the short- 
est distance from undcrlap A U A c to the hypcr-rcctanglc that defines the fuzzy power 
set of overlap A n ^ equals the distance d(A V A\ A n A<) =-- d(A, A‘) and equals 
a dificrence of vector magnitudes: d = M(A \J A) — M(A fl y4 ). 



Figure 16.11 Entropy-Subsethood Theorem in two dimensions. Just as the 
long diagonals have equal length, d(A, A c ) = d{AuA e , Af\A e ) = d - M{AU A ) 
M(A n /t e ), theshortest distance from AUA'to the fuzzy power set of A n A e . 


The Entropy-Subsethood Theorem implies that no probability measure measures fuzzi- 
ness For the moment, suppose not. Suppose fuzzy entropy measures nothing new; fuzzi- 
ness is simply disguised probability. Suppose, as Lindley (1987) claims, that probability 
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c 


theory *is adequate for all problems invol.ins uncertainty." Then there exists some proba- 
bility measure P such that /> = E. E cannot equal aero everywhere hccar.se IT A') - 1. 
Then there is some /I such that I'M) = E{A) > 0. lint in a probability space overlap 
or undcrlap arc degenerate: A H A — ®» A V A X ^ 

The Entropy-Subscll.oodTI.corcmtl.cn implies that 0 < P{A) = F{A) = S(MJA e ^ 

^ n _ S(X, 0). A' can be a subset to nonzero degree of tl.c empty set only if A 

itself is empty, and hence only if A is empty: X - A = 0. Then the sure event X is 

impossible: P{ X) = P{0) = »• Or the impossible event is sure: F(0) - 1- Either 

outcome gives a bivalent contradiction, impervious to normalization. So there exists no 
probability measure P that measures fuzziness. Fuzziness exists. 


i 


( 


l 
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7. Prove the fuzzy Dc Morgan Laws*. 

(a) AnB = {A e uB e ) c 

(b) AD B — (A £ n B e ) e 


8. Prove: 


o <r(A, a*.,) r>i- 


}Ip 


9. Prove the C-vcrf on of the Foray Entropy Theorem: 

l'(A,A«.,) _ n /P) 
£('’> = “ MMU*) 


10. Prove: M(/l) + Jf (« = n B) + M(4 U B). 

11. Prove: lMMf>^ , )+i M ( /,U ' 4 ‘ ) = 1 ' 


12. Prove: 

(a) B(P) = ^ « M < P > = 1 “d >U Pi < lA 

(b) £(P) < * K «( P > = 1 “ d »me Pi > !/2- 

13. Prove the fit-violation verrion ol the Snbsethood Thoerem: 

^max(0,mx - m B (x)) ^(A n B) 
S(A.B) = 1 “ — A|(A) ” 


14. Prove: 


S(B,//.)= k 


S(H h E)Ji_ 


£s(*i.£)/i 


;=» 


where 


f . = S(X,Hi), the nonfuzzy sots #t Bk partition X, and 


15. Prove: 


S(E,H)> s{H,E)fH + S{H c ,E)f7<' 


E is fuzzy. 
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where = S(XJI) and B and It arc arbitrary Uxrxy sets. 

If.. Prove the Odds-Form Bayes Theorem: 

S (A x niiM _ 

5(/\,n//,7 1) " S(.d5n//,/ti) 5(//,/i 2 ) 

for arbitrary fuzzy sets /h, ^ 1 . and 

17. Prove directly the additive inequality: S(j 4,B) + S (^. B ) - l * 

18. Prove: 

(a) 0 <S{It,A)<\, 

(b) S(//,A) = 1 ^ /,C ' 1 ’ 

(c) S(fl,A u /l.) = S{B,Ai) + - S{H.A,nA,) , 

(d) S(//, Ai n A s ) = S(H,Ax) S(4i n II, A 7 ) - 

19. Show that N.m*)) = * f« the generalized negation operator 

*•<*>“ TO O- 1 ’ 

20. If we define intersection Or pointwise by 

r(x, y) = 1 - min(l, ( (1 - *)' + 0 ~ / ^’ P > 

define the corresponding De Morgan dual union Us? 


U 


how should wc 1 


21. What Dc Morgan 


dual union operator corresponds to the in's, section operator 


tnax(0, i + y - 1) ? 
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2. Zadeh’s consequent conjunction syllogism schematizes as 
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Q\ As a.c Bs 
Qj As aro. Cs 


Therefore: Q /Is arc Bs and Cs 

Show that if Qi = S(A,B) and Q 5 = S(A,C), then the fuzzy quantifier Q obeys 
max(0,Q, +Qj-1) < Q < min(Qi,Qj). 


23. Define the volume svbsclhood measure V(A, B) as 


V(A,B) 


v(i4 n B) 


< 


for fit vectors A = (a, a.) and B = (l, W ‘bat c. > 0. o(A) is 

the Lebesgue or volume measure of A: 


v(a) = n • 

is 1 

The volume subsethood measure V(A,B) measures the ratio of the volume of the 
overlap hyper-rectangle F(2 An °) to the volume of A’s fuzzy power set F(2 A ). Prove 
that the volume subsethood measure V(A,B) underestimates the subsethood mea- 

sure S(A, B): 


V(A,B) < S(A,B) . 
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ADAPTIVE FUZZY SYSTEMS FOR BACKING 
UP A TRUCK- AND-TRAILER 


Seong-Gon Kong and Bart Koslco 
Department of Electrical Engineering 
Signal and Image Processing Institute 
University of Southern California 
Los Angeles, California 90089-0272 


Abstract f 

Wc developed fuzzy and neural-network control systems to back up a simulated truck, 
and truck-and-trailer, to a loading dock in a planar parking lot. The furry systems per- 
formed well until we randomly removed over 50 % of their fussy-a ss oci a tivc- i nem oi y (FAM) 
rules. They also performed well when we replaced key FAM equilibration rules with de- 
structive or “sabotage" rules. We trained the neural network systems with the supervised 
backpropagation learning algorithm and tested their robustness by removing random sub- 
sets of training data in learning sequences. The neural systems performed wdl but required 
extensive computation for training. We used unsupervised differential competitive learn- 
ing (DCL), and product-space clustering, to adaptively generate FAM rules from training 
data The original fuzzy and neural control systems generated trajectory data. The DCL 
system rapidly recove r ed the underlying FAM rules. Product-space clustering converted 
the neural truck systems into structured sets of FAM rules that approximated the neural 
system’s behavior. 
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Fuzzy and Neural Control Systems 


We construct fuxxy and neural control systems directly from control data, but from 
different types of control data. Furry systems use a small number of structured linguistic 
input-output samples from an expert or from some other adaptive es tim a t or. Neural 
systems use a large number of numeric input-output samples from the control process or 
from some other database. Adaptive furry systems also use numeric control d a t a. 

figure 1 illustrates this difference. The neural system estimates function / : X — ► Y 
from several numerical point samples The furry system estimates / from a few 

fussy set samples or furry associations (A,-, J?;). 



FIGURE 1 Geometry of neural and furry function estimation. The neural 
approach (a) uses several numerical point samples. The furry approach (b) 
uses a few furry set samples. 


Fussy and neural systems offer a key advantage over traditional control approaches. 
They offer model-free estimation of the control system. The user need not specify how 
the controller’s output mathematically depends on its input. Instead the user provides a 
few common-sense associations of how the control variables behave. Or the user provides 
a statis tically representative set of numerical training samples. Even if a math-model 
controller is available, furry or neural controllers may prove more robust and easier to 
modify. 

Which system, fuzz y or neural, performs better for which type- of control problem de- 
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paid, on the type and availability of sample data. H expert. provide structured kao^edse 

of the control process, or if sufficient numerical training «npl» *« u “ wiUHe ’ ** ***** 
approach may be preferable. We can construct a fussy control syrtem with comparative 
cue when expert, or fussy engineer, provide accurate structured knowledge. A fi«y con- 
trol system seems a reasonable benchmarks such can*, even if we can develop a neural 
controller or math-mo del controller* 

If we Ime reproaitaiTe nomaial do. bot not stnctoxed expaiac, the Denal ap- 
proach may be ptetereble. Or . rtatUticJ mpmooii *PP»“* =“T *• —» *PP*r*&- 
The date simply tell their own »toiy — if there i* a rtory to tdL Yet raen he* we era 
„e a hybrid fomy-eemd *rt«m, an ad*.U,e ferny ^*m. We era era the moeemeJ 
data to generate fiiray associative memory (FAM) rola. The FAM rala era theefam the 
skeleton of a foray control oreWtectnra. In ebert, if .t metered lmowledge in nnrarilnhle, 
ertinmt. it. ThU may he more praetieM tlmn it ramld Sppera lmeraue of the nnmll nomber 
of control FAM rales needed to reliably control many realwodd processes. 

How can we compare fhzzy and neural controllers? Abrtract comparbon prove, difficult 
because both approaches build a control black box in different ways. Thai they buid black 
boxes distinguishes them from math-modd controlleis. It also suggests we can compare 
gi least approximately, by their black-box control performance. 

Each control system generated an output control nrfaec as it ranged over the common 
input space of parameter values. Figure 5 below shows threodimenrionrf control sur£a«s 
for the foxzy and neural controllers. For control system, with few input parameter, with 
moderately quantised range., we can store both fussy and nenrai controller*—** 
thar quantised control surfaces — as decision look-up table*. Then once we specify a system 
performance criterion, we can in principle quantitatively compare the controllers. 

Comparing system trajectories proved more complicated. In the case at hand, we 
wanted to back up a track, and trock-and-trailer, to a loading dock. We can measure and 
compare the quality and quantity of the track trajectory, peihap. with mean-sq«xed er- 
ror criteria. Intuitively, we preferred smooth short trajectories to jagged long trajectories. 
Beaching the loading-dock goal wa. also important. In practice it b the most impor- 
ts performance requirement. We must balance the trajectory type with the trajectory 



destination, and reduces to the pragmatic issue of b ala n ci n g meant and ends. 

Below we develop a simple furry control system and a ample neural control system 
for backing up a truck, and truck-and-trailer, in an open parking lot. The recent neural 
network truck backer-upper simulation of Nguyen and Widrow [1989] motivated our choice 
of control problem. 

The furry control system compared favorably with the neural controller in terms of 
black-box development effort, black-box computational load, smoothness of truck trajec- 
tories, and robustness. 

We studied robustness of the furry control systems in two ways. We deliberately added 
mnfnring FAM rules— “sabotage” rules— to the system, and we randomly removed differ- 
ent subsets of FAM rules. We studied robustness of the neural controller by randomly 
removing different portions of the training data in learning sequences. We also converted 
the neural control systems to structured FAM-bank systems. 

Backing up a truck 

Figure 2 shows the simulated truck and loading rone. The truck corresponds to the cab 
put of the neural truck in the Nguyen- Widrow neural truck backer-upper system. The 
three state variables & x, and y exactly determine the truck position. <f> specifies the angle 
of the truck with the horizontal The coordinate pair (x,y) specifies the position of the 
reu center of the truck in the plane. 

The goal was to make the truck arrive at the loading dock at a right angle (<f>f = 90*) 
and to the position (x,y) of the truck with the desired loading dock (x/,y y). We 
considered only backing up. The truck moved backward by some fixed distance at every 
stage. The loading zone corresponded to the plane [0, 100] X [0, 100], and (*/, y/) equaled 
(50,100). 

At every stage the fuzzy and neural controllers should produce the steering angle 6 that 
Kiifh up the truck to the loading dock from any initial position and from any angle in the 
loading cone. 
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loading dock ty.yp 


rear 



front 


FIGURE 2 Diagram of simulated truck and loading none. 


Fuzzy Truck Backer-Upper System — 

V* 

We first spedfied each controller’s input and output variables. The input variables were 
the truck angle <f> and the x-porition coordinate x. The output variable was the steering- 
angle signal B. We assumed enough clearance between tbe truck and the loading dock so 
we could ignore the y-porition coordinate. The variable ranges were as follows: 

0 < x < 100 , 

—90 <>j>< 270 , 

-30 < 0 < 30 . 

Positive values of B represented clockwise rotations of the steering wheel. Negative values 
represented counterclockwise rotations. We discretized all values to reduce computation. 
The resolution of <j> and B was one degree eac h . The resolution of x was 0.1. 

Next we specified the fuzzy-set values of the input and output fuzzy variables. Tbe 
fuzzy sets numerically represented linguistic terms, the sort of linguistic terms an expert 
might use to describe the control system’s behavior. We chose the fuzzy-set values of the 
fuzzy variables as follows: 
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Steering-angle «Km1 £ 

NB: Negative Big 

NM: Negative Median 

NS: Negative Small 

ZE: Zero 

PS: Positive Small 

PM: Positive Medium 

PB: Positive Big 

Fuzzy subsets contain elements with degrees of membership. A fuzzy membership 
function m A : Z — ► [0,1] assigns a real number between 0 and 1 to every dement z m 
the universe of discourse Z. This number m A (z) indicates the degree to which the object 
or data z belongs to the fuzzy set A. Equivalently, m A (z) defines the fit (fuzzy unit) value 
[Kosko, 1986] of dement z in A. 

Pozzy membership functions can have different shapes depending on the designer’s pref- 
erence or experience. In practice fuzzy engineers have found triangular and trapezoidal 
shapes help capture the modeler’s sense of fuzzy numbers and simplify computation. Fig- 
ure 3 shows membership-function graphs of the fuzzy subsets above. In the third graph, 
for example, 6 = 20* is Positive Medium to degree 0.5, but only Positive Big to degree 0.3. 

In Figure 3 the fuzzy sets CE, VE, and ZE are narrower than the other fuzzy sets. 
These narrow fuzzy sets permit fine control near the loading dock. We used wider fuzzy 
sets to describe the endpoints of the range of the fuzzy variables <f>, *, and 3. The wider 
fuzzy sets permitted rough control far from the loading dock. 

Next we specified the fuzzy “rulebase” or bank of fuzzy associative memory (FAM) rules. 
Fuzzy associations or “rules” (A, B) associate output fuzzy sets B of control values with 
input fuzzy sets A of input-variable values. We can write fuzzy associations as antecedent- 
consequent pairs or IF-THEN statements. 

In the truck backer-upper case, the FAM bank contained the 35 FAM rules in Figcre 4. 
For example, the FAM rule of the left upper block (FAM rule 1) corresponds to the followhig 
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FIGURE 3 Furry membership functions for each linguistic furry- set value. 
To allow finer control, the fairy sets that correspond to near the loading dock 
are narrower than the furry sets that correspond to far from the loading dock. 


furry association: 


IF x = LE AND 4> = RB, THEN 0 = PS. 


FAM rule 18 indicates that if the truck is in near the equilibrium position, then the 
controller should not produce a positive or negative steering-angle signal. The FAM rules 
in the FAM-bank matrix reflect the symmetry of the controlled system. 

For the initial condition x = 50 and <£ = 270, the furry truck did not perform well. 
The symmetry of the FAM rules and the furry sets cancelled the furry controller output in 
a rare saddle point. For this initial condition, the neural controller (and truck-and-trailer 
b elo w) also performed poorly. Any perturbation breaks the symmetry. For example, the 
rule (If x = 50 and <f> = 270, then 0 = 5) corrected the problem. 

The t h ree- dimensio nal control surfaces in Figure 5 show steering-angle signal outputs 
0 that correspond to all combinations of values of the two input state variables <f> and 
x. The control surface defines the fairy controller. In this simulation the correlation- 
minimum FAM inference procedure, discussed in [Kosko, 1990a], determined the funy 
control surface. If the control surface changes with sampled variable values, the system 
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FIGURE 4 


FAM-bank matrix for the fuzzy truck backer-upper controller. 



FIGURE 5 (a) Control surface of the fuzzy controller. Fuzzy- set values 

determined the input and output combination corresponding to FAM rule 2 
(IF x=LC AND <£=RB, THEN d=PM). (b) Corresponding control surface of 
the neural controller for constant value y=20. 
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behaves as an adaptive fuzzy controller. Belov ve demonstrate unsupervised adaptive 
control of the track and the truck-and-trailer systems. 

Finally, we determined the output action given the input conditions. We used the 
correlation-minimum inference method illustrated in figure 6. Each FAM rule produced 
the output fuzz y set clipped at the degree of membership determined by the input condi- 
tions and the FAM rule. Alternatively, correlation-product inference [Kosko, 1990a] would 
com bine FAM rules multiplicatively. Each FAM rule emitted a fit-weighted output fuzzy 
set Oi at each iteration. The total output O added these weighted outputs: 

O = £ 0 ,- ( 1 ) 

t 

= £min(/i,Si) , (2) 

i 

where /,• denotes the antecedent fit value and Si represents the consequent fuzzy set of 
steering-angle values in the ith FAM rule. Earlier fuzzy systems combined the output 
sets Oi with pairwise But this tends to produce a uniform output set O as the 

number of FAM rules increases. Adding the output sets Oi invokes the fuzzy verson of 
the Central limit Theorem. This tends to produce a symmetric, unimodal output fuzzy 
set O of steering-angle values. 

Fuzzy systems map fuzzy sets to fuzzy sets. The fuzzy control system's output defines 
the fuzzy set O of steering-angle values at each iteration. We must “defuzzify* the fuzzy 
set O to produce a numerical (point-estimate) steering-angle output value 9. 

As in (Kosko, 1990a], the simplest defuzzification scheme selects the value 

co r r es ponding to the maximum fit value in the fuzzy set. This mode- selection approach 
ignores most of the information in the output fuzzy set and requires an additional decision 
algorithm when multiple modes occur. 

Centroid defuzzification provides a more effective procedure. This method uses the 
fuzzy centroid 9 as output: 

J2 0 jmo(9j) 

9 = ^ , ( 3 ) 


c 
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FIGURE 6 Condition-minimum inference with centroid defuzzification 
method. Then FAM-ruIe antecedents combined with AND use the minimum 
fit value to activate consequents. Those combined with OR would use Jhe 
maximum fit value. f" 


where O defines a f v subset of the steering-angle universe of discourse © = {0i, . . . , 6,}. 
The central-limi t-theoxem effect produced by adding output fuzzy set 0; benefits both max- 
mode centroid defuzzifi cation. Figure 6 shows the correlation-minimum inference and 
defuzzification applied to FAM rules 13 and 18. We used centroid defuzzification 
in all simulations. 

With 35 FAM rules, the fuzzy truck controller produced successful truck backing-up 
trajectories starting from any initial position, figure 7 shows typical examples of the fuzzy- 
con trolled truck trajectories from different initial positions. The fuzzy control system did 
not use (“fire”) all FAM rules at each iteration. Equivalently most output consequent sets 
are empty. In most cases the system used only one or two FAM rules at each iteration. 
The system used at most 4 FAM rules at once. 

Neural Truck Backer-Upper System 

The neural truck backer-upper of Nguyen and Widrow [1989] consisted of multilayer 
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FIGURE 7 Sample track trajectories of the fusty controller for initial 
positions (x,y,<£)‘. (a) (20,20,30), (b) (30,10,220), and (c) (30,40,-10). 

feedfor ward neural networks trained with the backpropagation gradient-descent (stochastic- 
approximation) algorithm- The neural control system consisted of two neural networks: 
the controller network and the track emulator network. The controller networt produced 
an appropriate steering-angle signal output given any parking-lot coordinates (*,y), and 
the The emulator network computed the next position of the truck. The emulator 

network took as input the previous trad: position and the current steering- angle output 
computed by the controller network. 

We did not train the emulator network since we could not obtain “universal* synaptic 
connection w eight s for the truck emulator network. The backpropagation learning algo- 
rithm did not converge for some sets of training samples. The number of tr a i nin g samples 
for the emulator network might exceed 3000. For example, the combinations of training 
«nm pU of a given angle s-porition, y-position, and steering angle signal 9 might cor- 
respond to 3150 (18 x 5 x 5 x 7) samples depending on the division of the input-output 
product space. Moreover, the training samples were numerically s imil a r since the neuronal 
signals scaled values in [0, 1) or (—1, lj. For ex a m ple, we treated dose values, such 

as 0.40 and 0.41, as distinct sample values. 

Simple kinemat ic equations replaced the truck emulator network. If the track moved 
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backward from (x, y) to (x\^/) at an iteration, then 


x+rcos(«f>') , 

(4) 

y + rt in(^') , 

(5) 

<f> + 0 . 

(6) 


r denotes the fixed driving distance of the track for all backing movements. We used 
equations (4)— (6) instead of the emulator network. This did not affect the post-training 
performance of the neural truck backer-upper since the truck emulator network back- 
propagated only errors. 

We trained only the controller network with backpropagation. The controller network 
used 24 “hidden” neurons with logistic sigmoid functions. In the training of the truck- 
controller, we estimated the ideal steering-angle signal at each stage before we trained the 
controller network. In the simulation, we used the arc-shaped truck trajectory produced 
by the fuzzy controller as the ideal trajectory. The fuzzy controller generated each training 
sample (x,y, <£, 6) at each iteration of the backing-up process. We used 35 training sample 
vectors and needed more than 100,000 iterations to train the controller network. 

Figure 5b shows the resulting neural control surface for y = 20. The neural control 
surface shows less structure than the corresponding fuzzy control surface. This reflects 
the unstructured nature of black-box supervised learning. Figure 8 shows the network 
connection topology for our neural truck backer-upper control system. 

FigureJ) shows typical examples of the neural-controlled truck trajectories from sev- 
eral initial positions. Even though we trained the neural network to follow the smooth 
arc-shaped path, some learned truck trajectories were non-optimaL 

Comparison of Fuzzy and Neural Systems 


As shown in Figure 7 and 9, the fuzzy controller always smoothly backed up the truck 
but the neural controller did not. The neural-controlled truck sometimes followed an 
irregular path. 
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24 hidden nnlia 


FIGURE 8 Topology of our neural control system. 



FIGURE 9 Sample truck trajectories of the neural controller for initial 
positions (*,y,*): (a) (20,20,30), (b) (30,10,220), and (c) (30,40,40). 










(b) 



FIGURE 10 The fuzzy truck trajectory after we replaced the key steady- 
state FAM rule 18 by the two worst rules: (a) IF x = CE AND <f> = VE, 
THEN 8 = PB, and (b) IF * = CE AND <f> = VE, THEN 0 = NB. 


Training the neural control system was time-consuming. The baekpropagation algo- 
rithm required thousands of back-ups to train the controller network. In some cases, the 
learning algorithm did not converge. 

We “trained* the fussy controller by encoding our own common sense FAM rules. Once 
we develop the FAM-rule bank, we can compute control outputs from the resulting FAM- 
bank matrix or control surface. The fuzzy controller did not need a truck e m u l ator and 
did not require a math model of how outputs depended on inputs. 

The fuzzy controller was computationally lighter than the neural controller. Most 
computation operations in the neural controller involved the multiplication, addition, or 
logarithm of two real numbers. In the fuzzy controller, most computational operations 
involved comparing and two real numbers. 


Sensitivity Analysis 

We studied the sensitivity of the fuzzy controller in two ways. We replaced the FAM 
rules with destructive or “sabotage* FAM rules, and we randomly removed FAM rules. 
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FIGURE 11 Fussy truck trajectory when (a) no FAM ruler are removed 
and (b) FAM rule* 7, 13, 18 and 23 are removed. 

We deliberately chore sabotage FAM rules to confound the system. Figure 10 shows the 
trajectory when two sabotage FAM rules replaced the important steady-state FAM rule— 
FAM rule 18: the fussy controller should produce sero output when the truck is nearly in 
the correct parking position. Figure 11 shows the truck trajectory after we removed four 
randomly chosen FAM inks (7, 13, 18, and 23). These perturbations did not significantly 
affect the fussy controller 1 * performance. 

We studied robustness of each controller by e x am in i n g failure rates. For the fussy 
controller we removed fixed percentages of randomly selected FAM rales from the system. 
For the neural controller we removed training data. Figure 12 shows performance errors 
averaged over ten typical back-ups with missing FAM rules for the fussy controller and 
Tni«™» c tr aining data for the neural controller. The missing FAM rales and training data 
ranged torn 0 % to 100 % of the total. In Figure 12a, the docking error equaled the 
Euclidean distance from the actual final position (^, *, y) to the desired final position (<£/, 

*/» y/) : 


Docking Error = — 4>Y + (*/ ~ *)* + (?/ ~ 9? • ^ 


In Figure 12b, the trajectory error equaled the ratio of the actual trajectory length of the 
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FIGURE 12 Comparison of robustness of the controllers: (a) Docking and 
Trajectory error of the fussy controller, (b) Docking and Trajectory error of 
the neural controller. 


£ 


track divided by the straight line distance to the loading dock: 

length of track trajectory 

Trajectory Error dijtance(initial position, desired final position) 


( 8 ) 


Adaptive Fuzzy Track Backer-Upper 

Adaptive FAM (AFAM) systems generate FAM rales directly from training data. A 
one-dimensional FAM system, S : P* — * 1*, defines a FAM rale, a single association of the 
form (Ai t B { ). In this case the input-ootpnt product space equals J* x P. As fiscussed in 
[Kosko, 1990a], a FAM rale defines a cluster or ball of points in the product-space 

cnhe J* xP centered at the point (A* ft). Adaptive clustering algorithms can estimate the 
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unknown FAM rale (Af, ft) from training sample* in R 2 . We n*ed differential competitive 
learning (DCL) to reraver the bank of FAM rale* that generated the track training data. 

We generated 2230 track samples from 7 different initi al position* and varying an- 
gle*. We chose the initial positions (20,20), (30,20), (45,20), (50,20), (55,20), (70,20), and 
(80,20). We changed the angle from -60* to 240* at each initial position. At each step, the 
fuzzy controller produced output steering angle 9. The training vector. (*, <f>, 9) defined 
points in a three-dimensional product-space. * had 5 foray set values: LB , LC, CE, EC , 
and El. $ had 7 fuzzy set values: RB, EU , RV, VE, LV , LU , and Ift 0 had 7 foray set 
values: NB, NM , NS, ZE , PS, PM, and PB. So there were 245 (5 x 7 x 7) possible 

FAM cells. 

We FAM cells by partitioning the effective product-space. FAM cells near the 

center were smtSla than outer FAM cells because we chose narrow membership fanctions 
near the steady-state FAM cell. Uniform partitions of the product-space produced poor 
estimates of the original FAM rales. As in Figure 3, th» reflected the need to judiciously 
j-fitw. the fuxsy-set values of the system foray variables. 

We performed product-space clustering with the verson of DCL discussed in [Eosko, 
1990a). If a FAM cell contained at least one of the 245 synaptic quantisation vectors, we 

entered the co rr es ponding FAM rale in the FAM matrix. 

Figure 13a shows the input sample distribution of (*,$. We did not include the 
variable 6 in the figure. Training data clustered near the steady-state position (* =s 50 
and <f> = 9XT). Figure 13b displays the synaptic-vector histogram after DCL classified 2230 
training vectors for 35 FAM rales. Since successful FAM system generated the training 
samples, most training samples, rad thus most synaptic vectors, chutered in the steady- 

state FAM celL 

DCL product-space clustering estimated 35 new FAM rules. Figure 14 shows the DCL- 
estimated FAM bank rad the corresponding control surface. The DCL-estimated control 
surface visually resembles the underlying unknown control surface in Figure 5a. The two 
systems produce nearly equivalent track-backing behavior. This suggests adaptive product- 
space clustering can estimate the FAM rule, underlying expert behavior in many cases, 
even when the expert or fussy engineer cannot articulate the FAM rales. 
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FIGURE 13 (a) Input data distribution, (b) Synaptic-vector histogram. 

Differential competitive learning allocated synaptic quantisation vectors to 
FAM cell*. The steady-state FAM cdl {CE, VE; ZE) contained the most 
synaptic vector*. 
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FIGURE 15 (a) FAM bank generated by the neural control surface in 

Figure 5b. (b) Control surface of the neural BP-AFAM system in (a). 


We also used tie neural control surface in Figure 5b to estimate FAM rules. We divided 
the input-output product-space into FAM cells as in the fussy control case. I£ the neural 
control surface intersected the FAM cell, we entered the corresponding FAM rule in a FAM 
fryWW We averaged all neural control-surface values in a square region over the two input 
variables * and 4>. We assigned the average value to one of 7 output fussy sets. Figure 15 
shows the resulting FAM bank and corresponding control surface generated by the neural 
control taxtoot in Figure 5b. This new control surface resembles the original fussy control 
surface in Figure 5a more than it resembles the neural control surface in Figure 5b. Note 
the absence of a steady-state FAM rule in the FAM matrix in Figure 5a. 

Figure 16 compares the DCL-AFAM and BP-AFAM control surfaces with the fussy 
control surface in Figure 5a. Figure -b *hows the absolute difference of the control surfaces. 
As expected, the DCL-AFAM system produced less absolute error than the BP-AFAM 
lysiczn produced. 

Figure 17 shows the docking and trajectory errors of the two AFAM control systems. 
The DCL-AFAM system produced less docking error than the BP-AFAM system produced 
for 100 arbitrary backing-up trials. The two AFAM systems generated similar baddng-up 
tra jectori es. This suggests that blade-box neural estimators can define the front-end of 
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FIGURE 16 (a) Absolute difference of the FAM surface in Fignr e Sa and 

^cDCL^stimJdFAM surface in Figure 14b. (b) Absolute difference of *e 
FAM surface in Figure 5* and the neural-estimated FAM surface in Figure 15b. 


FAM-atructured systems. In principle we can urn this technique to generate structured 

FAM rules for any neural application. We can then inspect and refine these rules and 

p«h«p. replace the original neural system with the tuned FAM syriem. 


Fuxzy Truck- and-Trailer Controller 

Vk edded . toiler to the tmek^tan, u ta tie ori(b»l Nsuyeo-Widtow modd. 
18 .low. tie dmoleted tntdMxd-trdler qetem. We edded one more ~i*ble (ceb 
■■ C l. #') to tie tb.ee etete ™rixble. d the trdlerleu tn.de. Io thi. eue . FAM role teke* 

the farm 

IP X = LE AND *, = BB AND *.= ?0, TEEN fi = NS. 

The Soar .Ute eatable. x, V, *. ** *< ioiominoi tie podtiot. ot the troek.^d.t.dler 
tjtlan in tie ptane. ibxxy eatable * c.™*».d«d to * Hr tie tufledeu tntek. Four 
-t-to. t . gpectfied tie retatiee ceb exgle with reject to the eextarltae eloog the fdle.. 
*, raged bom -90* to 90*. The extaeme eeb «.(!«. 90* end -90* conopooded to two 
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(a) Docking Error 



(b) Trsyectory Error »..[• 



^ Back-up Trial 

- DCL-AFAM (solid) : noon - 1.1075, uL- 0.0839 

- BP-AFAM (dashed) : mean » 1.1453, SiL * 0.1016 


FIGURE 17 (a) Docking errors and (b) Trajectory errors of the DCL- 

AFAM and BP-AFAM control systems. 




(x.y) <*, j):Cwtatai 

(»,»): CirtMte CMTtfMte «f tfc* JrtS. 

: Aa«l« «f Ita «r*S*r wta Mrtaatal !V«j. 

$ e : hkdn «*>• «T Ita a* wUk mBr, [-»0^*V 
6 : Start* m*)t, 1*3100). 

P : A»*J* * »• *»Bw taOtad at wrt tar, [ -WOJ. 

FIGURE 18 Diagram of the simulated truck-and-trailer system. 

“jackknife" positions of the cab with respect to the trailer. Positive <j> e value indicated 
that the cab resided on the left-hand ode of the trailer. Negative value indicated that it 
resided on the right-hand side. Kgure 18 shows a positive angle value of <f> c . 

Pansy variables *, and <f> e defined the input variables. Funy variable 0 defined the 
output variable. 0 measured the angle that we needed to update the trailer at each itera- 
tion, We c ompu ted the steering-angle output 0 with the following geometric relationship. 
With the output 0 value computed, the trailer position (*,p) moved to the new position 

(W 

x' = x + rcos(& + 0), 00 

y' y + ran(<f> t + 0), (1®) 

where r denotes a fixed backing distance. Then the joint of the cab and the trader («,r) 
moved to the new position 

v! = x' — t cos(& + /?), (1!) 

v' = -lm(4>t + 0)> ( 12 ) 

where l d*""*** the trailer length. We updated the directional vector ( dxrU,dxrV) t winch 
defined the cab angle, by 

dirV = dirU + Au, (13) 

dirV' = dirV + Av, (M) 
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FIGURE 19 Membership graphs of the three fuzzy- set value* of fuzzy 
variable <f> c . 



FIGURE 20 FAM bank of the fuzzy truck-and-trailer control system. 

where Au = u' — u, and At; = 1 / — v. The new directional vector (dir IF 9 dirV) defines 
the new cab angle <ff c . Then we obtain the steering angle value as 0 = w bere 

denotes the cab angle with the horizontal. We chose the same fuzzy-set values and 
membership functions for fi as we chose for 0 • fi ranged from —30* to 30* . We chose the 
fuzzy-set values of $ c as JVE, ZR and PO as in figure 19. 

Figure 20 displays the 5 FAM-rule matrices in the FAM bank of the fuzzy truck-and- 
trailer system. In Figure 20 we fixed the fuzzy variable z as LE y LCj CE, RC , and RI. 
There were 735 (7 X 5 x 7 x 3) possible FAM rules and only 105 actual FAM rules. 

Figure 21 shows typical backing-up trajectories of the fuzzy truck-and-trailer control 
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FIGURE 21 Sample truck-and-trailer trajectories from the fuzzy con- 
troller for initial positions (x, y, fa, fa)' (*•) (25, 30, —20, 30), (b) (80, 30, 
210, -40), and (c) (70, 30, 200, 30). 



system from different initial positions. The truck- and- trailer backed up in different direc- 
tions depending on the relative position of the cab with respect to the trailer. The fuzzy 
control systems successfully controlled the truck-and-trailer in jackknife positions. 



BP Truck-and-Trailer Control Systems 

We added the cab-angle variable fa as to the backpropagation-trained neural truck con- 
troller as an input. The controller nqtkork contained 24 hidden neurons with output vari- 
able 0. The training samples consisted of 5-dimensional space of the form (x,f,fa,fa,0)- 
We trained the controller network with 52 training samples from the fuzzy controller: 26 
samples for the left half of the plane, 26 samples for the right half of the plane. We 
used equations (9)-{14) instead of the emulator network. Training required more than 
200,000 iterations. Some training sequences did not converge. The BP-trained controller 
performed wdl except in a few cases. Figure 22 shows typical backing-up trajectories of 
the BP tr w^V.and .t T^iler control system from the same initial positions used in Figure 21. 

We performed the robustness tests for tae fuzzy and BP-trained truck-and-trailer 
controllers as in the trailerless truck case. Figure 23 shows performance errors averaged 
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(b) 


(C) 


FIGURE 22 Sample track-and-trailer trajectories of the BP-trained con* 
trailer for initial positions (*, y, fa, fa): (a) (25, 30, —20, 30), (b) (80, 30, 210, 
-40), and (c) (70, 30, 200, 30). 


over ten typical back-ups from ten different initial positions. These performance graphs 
resemble closely the performance graphs for the trailerless track systems in figure 12. 


AFAM Truck-and-Trailer Control Systems 

We generated 6250 truck-and-trailer data using the original FAM system in Figure 20. 
We up the track-and-trailer from the same initial positions as in the trailer less track 

case. The trailer angle fa ranged from —60* to 240*, and the cab angle fa assumed only 
the three values —45*, 0*, and 45*. The training vectors (*, fa, fa, fi) defined points in the 
four-dimensional input-output product-space. We nonuniformly partitioned the product 
space into FAM cells to allow narrower fuzzy-set values near the steady-state FAM cell. 

We used DCL to train the AFAM track-and-trailer controller. The total number of FAM 
cells equaled 735 (7 X 5 X 7 x 3). We used 735 synaptic quantisation vectors. The DCL 
algorithm classified the 6250 data into 105 FAM cells. Figure 24 shows the synaptic-vector 
histogram corresponding to the 105 FAM rales. Figure 25 shows the estimated FAM bank 
by the DCL algorithm. Figure 26 shows the original and DCL-estimated control surfaces 
for the fuzzy trnck-and-trailer systems. 







(a) Fuzzy truck-and-tnikr 



(b) BP-Neural trock-aad-txaSer 


FIGURE 23 Comparison of robustness of the two truck-and-trailer con- 
trollers: (a) Docking and trajectory error of the fussy controller, (b) Docking 
and trajectory error of the BP controller. 


V 




FIGURE 24 Synaptic-vector histogram for the AFAM truck-and-trailer 
system. 



T > — :5gi . 
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FIGURE 25 DCL-estimated FAM bank for the AFAM truck-and-trailer 
system. 


Figure 27 shows the trajectories of the original FAM and the DCL-estimated AFAM 
truck-and-trailer controllers. Figure 27a and 27b show the two trajectories from the initial 
position (*, y, *t, *.) = ( 30 , 30 , 10 , 45 ). Figure 27c and 27d show the trajectories from 
initial position (60,30,210,-60). The original FAM and DCL-estimated AFAM systems 
exhibited comparable truck-and-trailer control performance except in a few cases, where 
the DCL-estimated AFAM trajectories were irregular. 
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(a) Original FAM 

i 



(c) Oriftsal FAM 


J 

1 

(b> DCUdtnted FAM 

J 

!r 


(d) DCL-«*tintted FAM 


FIGURE 27 Sample truck-and-trailer trajectories from the original and 
the DCL-estimated FAM systems starting at initial positions (*, y, <p«) — 
(30,30,10,45) and (60,30,210,— 60). 


Conclusion 


We quickly engineered fussy systems to successfully back up a truck and truck-and- 
t „ Siet system in a parking lot. We used only common sense and error-miffing intuitions 
to generate sufficient banks of FAM rqles. These systems performed well until we removed 
over 50 % of the FAM rules. This extreme robustness suggests that, for many estimation 
and control problems, different fussy engineers can rapidly develop prototype fassy systems 
th&t perform similarly and well* 

The speed with which the DCL clustering technique recovers the underlying FAM bank 
farther suggests that we can likewise construct fussy systems for more complex, higher- 
£mensional problems. For these problems we may have access to only incomplete numer- 
ical input-output data. Pure neural-network or statistical-process-control approaches may 
generate systems with comparable performance. But these systems will involve far greater 
computational effort, will be more difficult to modify, and will not provide a structured 
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representation of the system’s throughput. 

Onr neural experiments suggests that whenever we model a system with a neural net- 
work, for little extra computational cost we can generate a set of structured FAM rules that 
approximate the neural system’s behavior. We can then tune the fuzzy system by refining 
the FAM-rule bank with fuzzy-engineering rules of thumb and with further training data. 
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APPENDIX: Product-space Clustering with Differential 

Competitive Learning 


Product- sp&ce clustering [Kosko, 1990a] is a form of stochastic adaptive vector quanti- 
sation. Adaptive vector quantisation (AVQ) systems adaptively quantise pattern clusters 
in JP\ Stochastic competitive learning systems are neural AVQ systems. Neurons compete 
for the activation induced by randomly sampled patterns. The corresponding synaptic fan- 
in vectors adaptively quantise the pattern space IT. The p synaptic vectors m,- define the 
p columns of the synaptic connection matrix if. M interconnects the n input or linear 
neurons in the input neuronal field F x to the p competing nonlinear neurons in the output 
field Fy. Figure 28 below illustrates the neural network topology. 

Learning algorithms estimate the unknown probability density function p(x), which de- 
scribes the distribution of patterns in JT. More synaptic vectors arrive at more probable 
regions. Where sample vectors x are dense or sparse, synaptic vectors m,- should be dense 
or sparse. The local count of synaptic vectors then gives a nonparametric estimate of the 
volume probability P(V) for volume V C IT: 

P(V) = / y p(*)dx 

»■ 

Number of m,- € V 

» 4 

P 


(15) 

(16) 


In the externa case that V = fZ", this approximation gives P(V) = p/p = 1. For improb- 
able subsets V, P(V) = 0/p = 0. 



Stochastic Competitive Learning Algorithms 

The metaphor of competing neurons reduces to nearest-neighbor classification. The 
AVQ system compares the current vector random sample x(f ) in Euclidean distance to the 
p of the synaptic connection matrix M , to the p synaptic vectors m^t), . . - 

If the jth synaptic vector m^t) is closest to x(i), then the jth output neuron “wins” the 
competition for activation at time t. In practice we sometimes define the nearest N synaptic 
vectors as winners. Some scaled form of x(t) - m^f) updates the nearest or “winning- 
synaptic vectors. “Losers” remain unchanged: m<(t + 1) = nit(0* Competitive synaptic 
vectors converge to pattern-class centroids exponentially fast [Kosko, 1990b]. 

The following three-step process describes the competitive AVQ algorithm, where the 
third step depends on which learning algorithm updates the winning synaptic vectors. 


Competitive AVQ Algorithm 


1. Initialize synaptic vectors: mj(0) = x(i), * — l,...,p. 

Sam ple-dependent initialization avoids many pathologies that can distort nearest- 

neighbor learning. 

2. For random sample x(t), find ttie closest or “winning” synaptic vector m,(t): 

||m_,-(t) — x(t)|| = irpn||m,(t) -x(0ll » ( 17 ) 

where ||x]| J = ** + . . . + ** defines the squared Euclidean vector norm of x. Wc can 
iefae the N synaptic vectors closest to x as “winners". 

3. Update the winning synaptic vectors) nij(t) with an appropriate learning algorithm. 



Differential competitive learning (DCL) 


Differential competitive “synapses” learn only if the competing “nenron" changes its 
competitive status [Kosko, 1990c]: 

Thy- = Sjivj) [ Si(Zi) - TTlii ] , ( 18 ) 


or in vector notation, 


mi = Sj(yj) [ S(x) — mj ] , 


(19) 


where S(x) = (&(d ),••., &(*•)) “ d = («•*-.»*). "« denote, the synaptic 
weight between the ith neuron in input field F x and the jth neuron in competitive field 
Fy. Nonnegative signal functions S { and S s transduce the real-valued activations * and 
y . into bounded monotone nondecrearing signals <£>(*») and Sj(yj). mj and Sjfa) denote 
the time derivatives of m* and S,( W ), synaptic and signal velodties. 5j(y,) measure, the 
competitive status of the jth competing neuron in Fy. Usually 5,- approximate, a binary 
threshold function. For example, Sj may equal a steep binary logistic sigmoid, 

for some constant c> 0. The jth neuron wins the laterally inhibitive competition if Sj = 1, 
loses if Sj— 0. 

For discrete implementation, we use the DCL algorithm as a stochastic difference equa- 
tion [Kong, 1991]: 

i 

m .(t + l) = «,-(£) + « ASM*)) [ 5 W*)) - “iW 1 * ^e itt neuron wins, (21) 
m,(f + l) = if the ith neuron loses. (22) 

ASjfait)) denotes the time change of the jth neuron’s competition signal Sfa) in the 
competitive field Fy: 

(23) 


AS,-(jfi(t)) = sgn[Sj(yj(t + l))-Si(Vj(0)l 
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We define the signum operator sgn(x) as 


*§“(*) 


1 if *>0 

0 if x = 0 

— 1 if x < 0 


(24) 


{4} denotes a slowly decreasing sequence of learning coefficients, such as Ct = .1 (1 — 
*/ 2000) for 2000 training samples. Stochastic approximation [Huber, 1981] requires a de- 
creasing gain sequence {c,} to sappress random disturbances and to guarantee convergence 
to local minima of mean-squared performance measures. The learning coefficients should 
decrease slowly, 

^2 Ct = 00 , (25) 

1st 

but not too slowly, 

X)c* < 00 . (26) 

t=i 

Harmonic- series coefficients, c, = 1/t, satisfy these constraints. 

We approximate the competitive signal difference A Sj as the activation difference A yy. 


i 


ASjfyXO) ' = S P»( »(* + 1) - «#(0 ] 
= ♦ 


(27) 

(28) 


Input neurons in feedforward networks usually behave linearly: Si(x{) = x,-, or 5(x(t)) = 
x(t). Then we update the winning synaptic vector m,(f) with 


m,(t + l) = Jnj(t) + c, Ay_,(f) [ x(t) - mj(t) ] . 
We update the Fy neuronal activations yj with the additive model 


(29) 


Vi(t + 1) = PiO) + 53 5i(*i(t)) »»{,•(<) + £ &(»*(<)) w kj • (30) 

• h 


Z71 



♦ w 


Input Add F x CnmpdMoo Hdd F y 

FIGURE 28 Topology of the laterally inhibitive DCL network- 

For li nea r signal functions S,-, the first sum in (30) reduces to an inner product of sample 
and synaptic vectors: 

£ »(() »«(<) = x r (l)i»i(i) • (») 

« 

Then positive l eanin g tends to occur — > 0 — when x is dose to the jth synaptic 
vector m } -. 

Since a binary threshold function approximates the output signal function 
second sum in (30) sums over just the winning neurons: for all w innin g neurons yu • 

The p x p matTiT W contains the Fy within-field synaptic connection strengths. Di- 
agonal elements wa are positive, off-diagonal dements negative. Winning neurons excite 
themsdves and inhibit all other neurons. Figure 28 shows the connection topology of the 
laterally inhibitive DCL network. 
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Product-space clustering 

We divided the space 0 < * < 100 into five nonnniform intervals [0,32.5], [32-5,-4T-5], 

[47.5.52.5] , [52-5,67-5], and [67.5, 100]. Each interval represented the five foray-set values 
LE , LC, CE, RC , and RI. This choice corresponded to the nonoverlapping intervals 
of the foray membership function graphs m(*) in Figure 3. Similarly, we divided the 
space —90 < ^ < 270 into seven nonuniform intervals [—90,0], [0,66.5], [66-5,86], [86,94], 

[94.113.5] , [113-5, 182.5], and [1825,270], which corresponded respectively to RB, RU , 
RV, VE, LV , LU, and LB. We divided the space -30 < 0 < 30 into seven nommifbnn 
intervals [-30,-20], [—20,— 7.5], [—75,— 2.5], [—25,2.5], [2.5,75], [75,20], and [20,30], 
which corresponded to NB, NM, NS, ZE , PS, PM, and PB . 

DCL classified each input-output data vector into one of the FAM cells. We added a 
FAM rule to the FAM bank if the DCIrtrained synaptic vector fell in the FAM celL In 
case of ties we chose the FAM cell with the most densely clustered data. 

For the BP-AFAM generated from the neural control surface in Figure 15, we divided 
the rectangle [0,100] x [-90,270] into 35 nonnniform squares with the same divisions 
ArK-nrA above. Then we added and averaged the control surface values in the square. We 
added a FAM rule to the FAM bank if the averaged value corresponded to one of the seven 
FAM cells. 

For the truck- and-trafler case, we .divided the space —90 < <J> e < 90 into three intervals 
[-90,-125], [—12.5,12.5], and [125,90], which corresponded to NE, ZR, and PO. There 
were 735 FAM cells , and 735 possible FAM rules, of the form (x,4>t,feP)- 
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ADAPTIVE FUZZY SYSTEM FOR 
TARGET TRACKING 


Peter J. Pacini and Bart Kosko 
Department of Electrical Engineering 
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Los Angeles, CA 90089-0272 


ABSTRACT 

We compared fuzzy and Kalman-filter control systems for realtime target tracking. 
Both systems performed well, but in the presence of mild process (unmodeled effects) noise 
the fuzzy system exhibited finer control. We tested the robustness of the fuzzy controller 
by removing random subsets of fuzzy associations or “rules" and by adding destructive or 
“sabotage" fuzzy rules to the fuzzy system. We tested the robustness of the Kalman track- 
ing system by increasing the variance of the unmodeled-effects noise process. The fuzzy 
controller performed well until we removed over 50% of the fuzzy rules. The Kalman con- 
troller’s performance quickly degraded as the unmodeled-effects variance increased. We 
used unsupervised neural-network learning to adaptively generate the fuzzy controller’s 
fuzzy- associative-memory structure. The fuzzy systems did not require a mathematical 
model of how system outputs depended on inputs. 
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Fuzzy and M^th-Modd Controllers 


Fuzzy controllers differ from classical math-model controllers. Fuzzy controllers do 
not require a mathematical model of how control outputs functionally depend on control 
inputs. Fuzzy controllers also differ in the type of uncertainty they represent and how they 
represent it. The fuzzy approach represents ambiguous or fuzzy system behavior as partial 
implications or approximate “rules of thumb’-as fuzzy associations (A,-, Bf). 

Fuzzy controllers are fuzzy systems. A finite fuzzy set A is a point (Kosko, 1987J in 
a unit hypercube /“ = [0,1]“. A fuzzy system F : - /Ms a mapping between 

unit hypercubes. /" contains all fuzzy subsets of the domain space X = 

/« 5s the ykrzy power set F(2 X ) of A'. /' contains all the fuzzy subsets of the range 
space Y = {y x ,...,y P }. Element x ; e A belongs to fuzzy set A to degree m A (x { ). The 2“ 
nonfuzzy subsets of A correspond to the 2“ comers of the fuzzy cube /". The fuzzy system 
F maps fuzzy subsets of A to fuzzy subsets of Y. In general, A and V are continuous not 

discrete sets. 

Math-model controllers usually represent system uncertainty with probability dis- 
tributions. Probability models describe system behavior with first-order and second-order 
statistics— with conditional means and covariances. They usually describe unmodeled ef- 
fects and measurement imperfections with additive “noise” processes. 

Mathematical models of the system state and measurement processes facilitate a mean- 
squared-error analysis of system behavior. In general we cannot accurately articulate such 
mathematical models. This greatly restricts the range of realworld applications. In practice 
we often use linear or quasi-linear (Markov) mathematical models. 

Mathematical state and measurement models al'so make it difficult to add non-mathem- 
atical knowledge to the system. Experts may articulate such knowledge, or neural networks 
may adaptively infer it from sample data. In practice, once we have articulated the math 
model, we use human expertise only to estimate the initial state and covariance conditions. 

Fuzzy controllers consist of a bank of fuzzy associative memory (FAM) “rules” or 
associations (A.-, Bi) operating in parallel, and operating to different degrees. Each FAM 
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rule is a set-level implication. It represents ambiguous expert knowledge or learned input- 
output transformations. A FAM rule can also summarize the behavior of a specific math- 
ematical model. The system nonlincarly transforms exact or fuzzy state inputs to a fuzzy 
set output. This output fuzzy set is usually “defuzzified” with a centroid operation to 
generate an exact numerical output. In principle the system can use the entire fuzzy dis- 
tribution as the output. We can easily construct, process, and modify the FAM bank of 
FAM rules in software or in digital VLSI circuitry. 

Fuzzy controllers require that we articulate or estimate the FAM rules. The fuzzy-set 
framework provides more expressiveness than, say, traditional expert-system approaches, 
which encode bivalent propositional associations. But the fuzzy framework does not elimi- 
nate the burden of knowledge acquisition. We can use neural network systems to estimate 
the FAM rules. But neural systems also require an accurate (statistically representative) 
set of articulated input-output numerical samples. Below we use unsupervised competitive 
learning to adaptively generate target-tracking FAM rules. 

Experts can hedge their system descriptions with fuzzy concepts. Although fuzzy con- 
trollers are numerical systems, experts can contribute their knowledge in natural language. 
This is especially important in complex problem domains, such as economics, medicine, 
and history, where we may not know how to mathematically model system behavior. 

Below we compare a fuzzy controller with a Kalman-filter controller for realtime target 
tracking. This problem admits a simple and reasonably accurate mathematical description 
of its state and measurement processes. We chose the Kalman filter as a benchmark because 
of its many optimal linear-systems properties. We wanted to see whether this “optimal” 
controller remains optimal when compared with a computationally lighter fuzzy controller 
in different uncertainty environments. 

We indirectly compared the sensitivity of the two controllers by varying their system 
uncertainties. We randomly removed FAM rules from the fuzzy controller. We also added 
“sabotage” FAM rules to the controller. Both techniques modeled less-stuctured control 
environments. For the Kalman filter, we varied the noise variance of the unmodeled-effects 
noise process. 

Both systems performed well for mildly uncertain target environments. They degraded 
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differently as the system uncertainty increases. The fuzzy controller’s performance de- 
graded when we removed more than half the FAM rules. The Kalman-filtcr controller s 
performance quickly degraded when the additive state noise process increased in variance. 


Realtime Target Tracking 


A target tracking system maps azimuth-elevation inputs to motor control outputs. The 
nominal target moves through azimuth-elevation space. Two motors adjust the position 
of a platform to continuously point at the target. 

The platform can be any directional device that accurately points at the target. The 
device may be a laser, video camera, or high-gain antenna. We assume we have available 
a radar or other device that can detect the direction from the platform to the target. 

The radar sends azimuth and elevation coordinates to the tracking system at the end 
of each time interval. We calculate the current error e* in platform position and change tn 
error e*. Then a fuzzy or Kalman-filter controller determines the control outputs for the 
motors, one each for azimuth and elevation. The control outputs reposition the platform. 

We can independently control movement along azimuth and elevation if we apply the 
same algorithm twice. This reduces the problem to matching the target’s position and 
velocity in only one dimension. 

Figure 1 shows a block diagram of the target tracking system. The controller’s output 
vie gives the estimated change in angle required during the next time interval. In principle 
a hardware system must transduce the angular velocity v k into a voltage or current. 
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FIGURE 1 Target tracking system. 


FUZZY CONTROLLER 


We restrict the output angular velocity vs of the toy controller to the interval [-6, 6]. 
So we must insert a gain element before the voltage transduction. This gain must equal 
oue-sixth the maximum angle thmugh which the platform can turn in one time interval. 
Similarly, the position error es must be scaled so that 6 equals the maximum error. The 
product of this scale factor and the output gain provides a design parametcr-the “gain” 
of the fuzzy controller. 

The fuzzy controller uses heuristic control set-level rules or fuzzy associative mem ry 
(FAM) associations based on quantized values of e*, e*, and ut-i- We define seven fu y 
levels by the following library of toyset values of the toy variables ea, «>, and vs-.: 
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LN : 

Large Negative 

MN : 

Medium Negative 

SN : 

Small Negative 

ZE : 

Zero 

SP : 

Small Positive 

MP : 

Medium Positive 

LP : 

Large Positive 


We do nol quantize inputs in the classical sense that we assign each input to exactly 
one output level. Instead, each linguistic value equals as a fuzzy set that overlaps wrth 
adjacent fuzzy sets. The fuzzy controller uses trapezoidal fuzzy-set values, as Figure 2 
shows. The lengths of the upper and lower bases provide design parameters that we must 
calibrate for satisfactory performance. A good rule of thumb is ajjaceat fazxysel xal.es 
should oucrlup approximately 25 percent. Below we discuss examples of calibrated and 
uncalibrated systems. The fuzzy controller attained its beet performance with upper and 
lower bases of 1.2 and 3.9—26.2% overlap. Different target scenarios may require more or 

less overlap. 
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of disburse. 


We assign each system input to a fit vector of length 7, where the ith fit, or fuzzy unit 
[Kosko, 1986], equals the value of the till fuzzy set at the input value. In other words, 
the ith fit measures the degree to which the input belongs to the ith fuzzy-set value. For 
instance, we apply the input values 1, -4, and 3.8 to the seven fuzzy sets in the library to 
obtain the fit vectors 

1 — ♦ (0 0 0 .7 .7 0 0) , 

—4 — ► (0 1 0 0 0 0 0), 

3.8 — >(0 0 0 0 .1 1 0 ) . 

We determine these fit values above by convolving a Dirac delta function centered at the 
input value with ea c h of the 7 fuzzy sets: 

m S p(3.8) = S(y - 3.8) * m S p{y) ~ -1 • ( X ) 

If we use a discretized universe of discourse, then we use a Kronecker delta function in- 
stead. Equivalently, for the discrete case n-dimensional universe of discourse X = {*i,..., 
x n }, a control input corresponds to a bit (binary unit) vector B of length n. A single 1 
element in the ith slot represents the “crisp” input value x,-. Similarly, we represent the 
Jfcth library fuzzy set by an n-dimensional fit vector Ak that contains samples of the fuzzy 
set at the n discrete points within the universe of discourse X. The degree to which the 
crisp input x f activates each fuzzy set equals the inner product B • A k of the bit vector B 
and the corresponding fit vector At- 

We formulate control FAM rules by associating output fuzzy sets with input fuzzy sets. 
The antecedent of each FAM rule conjoins ejt, et, and u t _, fuzzy-set values. For example, 

IF tk = MP AND ik = SN AND ufc_ t = ZE, THEN v k = SP. 


We abbreviate this as ( MP,SN,ZE\SP ). 
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Tlie scalar activation value <* of the fth FAM role’s consequent equals the minima, 
of the three antecedent conjunct values. If alternatively we combine the antecedents 
disjunctively with OR, the activation degree of the consequent would equal the musrmmn 
of the three antecedent disjoncts' values. In the following example, ma(ea) denotes the 
degree to which et belongs to the fuzzy set A. 





LN 

MN 

SN 

ZE 

SP. 

MP 

LP 

Ct 

-- 

2.6 — * 

(0 

0 

0 

0 

1 

.4 

0) 

Ct 


-2.0 — ♦ 

(0 

0 

1 

0 

0 

0 

0) 

Vk-1 

= 

18 — + 

(0 

0 

0 

.1 

1 

0 

0) 


= 

.4 








msN(cfc) 


1 








mzE( v k- i) 

= 

.1 








w; 


min(.4, 1, -1) = 

.1 . 








So the system activates the consequent fuzzy set SP to degree w, -1. 

The output fussy set’s shape depends on the FAM-rule encoding scheme used. With 
correlation-minimum encoding, we clip the consequent fussy set U in the libnuy of fussy- 
set values to degree tu g - with pointwise minimum: 

mo.(y) = min(tx7,-,mt.(y)) . ™ 

With correlation-product encoding, we multiply /», by u?,: 

mo.(y) = WimLsi V) » ^ 

or equivalently, 

Oi = Wi Li . ^ 

Figure 3 illustrates how both inference procedures transform L { to scaled output O t . For 
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the example above, correlation- product inference gives output fuzzy set O, .1 

where Li = SP denotes the fuzzy set of small but positive angular velocity values. 



Consequent Li Output O i 



Consequent L i Output 0 j 


FIGURE 3 FAM inference procedure depends on FAM rule encoding proce- 
dure: (a) correlation-minimum encoding, (b) correlation-product encoding. 


The fuzzy system activates each FAM rule consequent set to a different degree. For the 
ith FAM rule this yields the output fuzzy set O., The system then sums the C. to form 
the combined output fuzzy set O. 


N 

o = Jo.- , 

i=l 

or equivalently, 

H 

m o(y) = 51 m o.{y) • 

t=i 

The control output v k equals the fuzzy centroid of O: 


Vk 


j y m 0 (y)dy 

J m 0 (y)dy 


( 5 ) 

( 6 ) 

( 7 ) 


where the limits of integral ion correspond to the entire universe of discourse Y of angular 
velocity values. Figure A sliows an example of correlation-product inference for two FAM 
rules followed by centroid defuzzification of the combined output fuzzy set. 


SP ZE 


ZE SP 


H c k - SP and c % - ZE and v*., 
then v fc - SP. 


tf e k - ZE 2 nd e* - SP and 
then v k « ZE. 



FIGURE 4 Correlation-product inferences followed by centroid defuzzifi- 
cation. FAM rule antecedents combined with AND use the minimum fit value 
to activate consequents. Those combined with OR use the maximum fit value. 

To reduce computations, we can discretize the output universe of discourse Y tc p values, 
Y = {yi,...,y p }, which gives the discrete fuzzy centroid 


Eft m 0 (r/j) 
i=i 

v t = — 

J2 m o(yj) 

i=i 


( 8 ) 


Fuzzy Centroid Computation 


We Dy\v develop two discrete methods for computing the fuzzy centroid (7). Theorem 
1 states that we can compute the global centroid v k from local FAM-rule centroids. The- 
orem 2 states that v k can be computed from only 7 sample points if all the fuzzy sets 
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arc symmetric and unimodal (in the broad sense of a trapezoid peak), though otherwise 
arbitrary. Both results reduce computation and favor digital implementation. 

Theorem 1: If correlation-product inference determines the output fuzzy sets, then we 

can compute the global centroid vt from local FAM-rulc centroids. 

N 

Vk = ^ 7 — • 

i-l 

Proof. The consequent fuzzy set of each FAM rule equals one of the fuzzy-set values 
shown in Figure 2. We assume each fuzzy set includes at least one unity value, m*(x) = 1. 
Define J; and c,* as the respective area and centroid of the tth FAM rule’s consequent set 

L { : 

A = j )dy , (10) 

J y m Li {y)dy 
J m Li (y)dy 

J ym Li {y)dy 

= l ’ 


substituting from (10). Hence 

J y m L '(y)dy = c, /,• . (n) 

Using (3), the result of correlation-product inference, we get 

J y ™oi{y)dy = J y w > m ’Av)dy 


2S5 


= Wi J y mt,( y)dy 

— WiCili , ( 12 ) 


substituting from (11)- Similarly, 

J rn 0 i {y) dy = J u>; m Li (y)dy 


(13) 


substituting from (10). 

We. can use (12) and (13) to derive a discrete expression equivalent to (7): 

N 

J ymo(y)dy = J yCm 0i (y)]dy substituting from (6) , 

= 12 J V m Oi(y) dy 

= > 


(14) 


from (12). Similarly, 


J m 0 (y)dy = J Y,m 0 i (y)dy 
= 12 J m o.(y)dy 

i 

= £>/, , (I 5 ) 

t 

from (13). Substituting (14) and (15) into (7), we derive a new form for the centroid: 
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N 

5Z WiCih 

v t = . ( lC ) 

«=i 

which is equivalent to (9). Each summand in each summation of (16) depends on only 
a single FAM rule. So we can compute the global output centroid from local FAM-rulc 
centroids. Q.E.D. 


Theorem 2: If the 7 library fuzzy sets are symmetric and unimodal (in the trapezoidal 

sense) and we use correlation-product inference, then we can compute the centroid v* from 
only 7 samples of the combined output fuzzy set O: 


i=l 

t>fc = — 

Z>o(y,) Jj 

i= i 


(17) 


The 7 sample points are the centroids of the output fuzzy-set values. 


Proof. Define 6, as a fit vector of length 7, where the fit value corresponding to 
the ith consequent set has the value w and the other entries equal zero. If all the fuzzy 
sets are symmetric and unimodal, then the jth fit value of O, is a sample of mo, at the 
centroid of the jth fuzzy set. The combined output fit vector is 

o = jrdr ■ • ( 18 ) 

i=i 

Since ^ 

m 0 ( y) = Y m °<(y) » 

i=i 

the jth fit value of O is a sample of mo at the centroid of the jth fuzzy set. Equivalently, 
the jth fit value of O equals the sum of the output activations u>; from the FAM rules with 
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consequent fuzzy sets equal to the jth library fuzzy-set value. 

Define the reduced universe of discourse as Y = {»/i, — .I^t} such that y j equals the 
centroid of the jth output fuzzy set. In vector form 

Y = (yi.-.-.y?) 

= (- 6 , - 4 , - 2 , 0 , 2 , 4 , 6 ) 

for the library of fuzzy sets in Figure 2. Also define the diagonal matrix 

J = diag(Ji,...,^7) i 

where Jj denotes the area of the jth fuzzy-set value. If the ith FAM rule’s consequent fuzzy 
set equals the jth fuzzy-set value, then the jth fit value of O increases by tc,-, c,- - y,, 
and Ii = Jj- So ^ 

ojy t = YL m o(yj)yj J j = H2 WiCiIi • ^ 

i=i •=> 


' 7 * 

OJl T = Z m o(Vi) J i = Y. WiI{ > 
i=i i=1 

where 1 = Substituting (20) and (21) into (16) gives 


Vk = 


Y^ m o(yi) Vi J i 

ifi 

7 

£m 0 (y;) J i 


which is equivalent to (17). Therefore, (22) gives a simpler, but equivalent form of the 
centroid (7) if all the fuzzy sets are symmetric and unimodal, and if we use correlation- 

product inference to form the output fuzzy sets O,-. Q.E.D. 

Consider a fuzzy controller with the fuzzy sets defined in Figure 2, and 7 FAM rules 

with the following outputs: 
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t Wi Consequent 


1 

0.0 

MP 

2 

0.2 

SP 

3 

1.0 

ZE 

4 

0.4 

SN 

5 

0.1 

SP 

6 

0.8 

ZE 

7 

0.6 

SN 


Figure 5 shows the combined output fuzzy set O, with the SN, ZE 
displayed with dotted lines. Using (7) we get a velocity output of 
the combined output fit vector O equals (0, 0, 1.0, 1.8, 0.3, 0, 0). 

-2x1 + 0x1.8 -f 2x0.3 _ 

1 + 1.8 + 0.3 


', and SP components 
-0.452. Alternatively, 
From (22) we get 


vt = 


-0.452 . 



FIGURE 5 Output fuzzy set O. 


Fuzzy Controller Implementation 


A FAM bank or “rulebase” of FAM rules defines the fuzzy controller. Each FAM rule 
associates one consequent fuzzy set with three antecedent fuzzy-set conjuncts. 

Suppose the ith FAM rule is (MP,SN,ZE,SP). Suppose the inputs at time k are 
e k = 2.6, ejt = -2.0, and v*_i = 1-8. Then 


W{ = min(mAfp(et), ms/v(et), mzE( v k-i )) 

= min(.4, 1, .1) 

= .1 . 

If all the fuzzy sets have the same shape, then they correspond to shifted versions of a 


290 



single fuzzy set ZE: 

m S r(y) = m !C (y - 2) . 

Define c\ e‘, and «• as the centroids of the corresponding antecedent fuzzy sets in the 
example above. So e' = 4, e' = —2, and o' = 0. Then the output activation equals 

Wi = min (mze(et - e'), m ZE (et - e'), m 2E (o t _i - o')) 

= min(m Z e(— 1.4), m ZE ( 0), m ZE (1.8)) 

= min(.4, 1, .1) 

= -1 , 

as computed above. Figure 6 schematizes such a FAM rule when presented with crisp 
inputs. 


v k-s 



0 : 


FIGURE 6 Algorithmic structure of a FAM rule for the special case of 
identically-shaped fuzzy sets and correlation-product inference. 
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The output fuzzy set 0; in Figure 6 equals the fuzzy set ZE scaJcd by w; and shifted 
by c,: 

ma(y) = w,m z£ (y - c.) . (23) 

Figure 7 i"ustrates O,-. 



FIGURE 7 Trapezoidal output fuzzy set O,-. 

The fuzzy control system activates a bank of FAM rules operated in parallel, as shown 
in Figure 8. The system sums the output fuzzy sets to form the total output set O, which 
the system converts to a “defuzzified” scalar output by computing its fuzzy centroid. 
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FIGURE 8 Fuzzy control system as a parallel FAM bank with centroidal 
output. 


KALMAN FILTER CONTROLLER 


We designed a one-dimensional Kalman filter to act as an alternative controller. The 
state and measurement equations take the general form 


z fc+ i = $k+i,k + I'm-*.* Wk + Ufc ’ 

zt = Hk *k + Vk t 


( 24 ) 


where W denotes Gaussian white noise with covariance matrix fir. It <4 is colored no.se 
or it fir = 0, then the filtering-error covariance matrix fir,r becomes singular. The state x» 
and the measurements z. are jointly Gaussian. Mendel (IN* gives details ,t this model. 
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Assume Ihc following one-dimensional model: 


$k+l,k — IYf|,k = Vk+ijc — Hk — 1 f° r 

t i t = Ck + e* . (25) 

Let n+i denote the output velocity required at time Ic to exactly lock onto the target at 
time Jb+1. So the controller output at time Jk equals the “predictive” estimate x i+ ,| t = v k . 
Note that 

e* = Xk — 

= i 

Cfc = Cfc — Cfc_i . 

Substituting (25) into (24), we get the new state equation 

Xk + 1 = Xk + e* + Ck + Wk , (26) 

where Wk denotes white noise that models target acceleration or other unmodeled effects. 
The new measurement equation is 

Zk = X k + Vk 

= x k\k-l + H (^) 

= + K • • 

Since we assume x*n_ t and V k are uncorrelated, the variance of V* is 


K = B[VC) 

= Eixlk.,) + E[V?} 
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= Pk\k-\ + Rk • 

The general form of the recursive Kalman filter equations is 

+ R k [z k “ Hk i 

I<k = Pk\k-xHl[IIkPk\k-xllI + Rk\~ l , 

i t+ t|fc = ^t+l.t Xfclfc + ♦*+!.* «k > ^ 

Pk\k-i = + r'i, 1 t_it?k_ir J . it _, , 

Pk\k = V - KkIh)Pk\k-i , 

where Q k = Kcr(«>*) = E\w k w T k ). Substituting (25), (27), (28) and the definition of v t 
into (29), we get the following one-dimensional Kalman filter: 

i k \k = + Afcl'fc > 

K - Pk{k ~ l 
K ‘ - ' 

v k = xjt| fc + t k + e k , (3°) 

P k \k-i = Pk-i\k-i + Qk - i , 

P k \k = (1 - I<k]P k \k-x • 

Unlike the fuzzy controller, this Kalman filter does not automatically restrict the output 
v k to a usable range. We must apply a threshold immediately after the controller. To 
remain consistent with the fuzzy controller, we set ‘the following thresholds: 

|ujt| < 9 degrees azimuth , 

\vu\ < 4.5 degrees elevation. 
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Fuzzy and Kalman Filter Control Surfaces 

Each control system maps inputs to outputs. Geometrically, these input-output trans- 
formations define control surfaces. The control surfaces arc sheets in the input space 
(since the output velocity v k is a scalar). Three inputs and one output give rise to a 
four-dimensional control surface, which we cannot plot. Instead, for cadi controller we can 
plot a family of three-dimensional control surfaces indexed by constant values of the fourth 
variable, the error e k , say. Then each control surface corresponds to a different value of 

the error e*. 

The fuzzy control surface characterizes the fuzzy system’s fuzzy-set value definitions 
and its bank of FAM rules. Different sets of FAM rules yield different fuzzy controllers, 
and hence different control surfaces. Figure 9 shows a cross section of the FAM bank when 
e k = ZE. Each entry in this linguistic matrix represents one FAM rule with e k = ZE 
as the first antecedent term. 
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LP 

LP 

LP 

LP 


FIGURE 9 e k = ZE cross section of the fuzzy control system’s FAM bank. 

Each entry represents one FAM rule with e t = ZE as the first antecedent term. 
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l 



The shaded FAM rule is “IF e k ~ ZE AND c* = SP AND = SN , 
THEN u* = ZE,” abbreviated as (ZE,SP,SAf; ZE). Note the ordina 1 inti- 
symmetry of this FAM-bank matrix. The six other cross-section FAM-bank 
matrices arc similar. We can eliminate many FAM rule entries without greatly 
perturbing the fuzzy controller’s behavior. 

The entire FAM bank — including cross sections for e* equal to each of the seven fuzzy- 
set values EAf, MN , SN , ZE, 5P, A/P, and LP — determines how the system maps input 
fuzzy sets to output fuzzy sets. The fuzzy set membership functions shown in Figure 2 
determine the degree to which each crisp input value belongs to each fuzzy-set value. So 
both the fuzzy-set value definitions and the FAM bank determine the defuzzified output 
v k for any set of crisp input values e kl e k , and 

Figure 10 shows the control surface of the fuzzy controller for e k = 0. We plotted the 
control output u* against e* and v k -\ - Since we use the same algorithm for tracking in 
azimuth and elevation, the control surfaces for the two dimensions differ in scale only by 
a factor of two. 



FIGURE 10 Control surface of the fuzzy controller for constant error 
e t = 0. We plotted the control output v k against c k and ut_i along the 

respective west and south borders. 

The Kalman filter has a random control surface that depends on a time-varying pa- 
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rameter. From (30) we see that 


Vk = ik\k + c* -f e k , 
ik\k = + KkVl i 


where V* denotes white noise with variance given by (28). Combining these two equations 
gives the equation for the random control surface: 

Vk = v k -i +Ck +e k + /u-Vj . (31) 

At time k the noise term Kk VS has variance 


a\ = I<1 K k 

_ Pk\k-l 


upon substituting from (30) , 


Pk\k-i + Rk' 

substituting from (28). Combining (31) and (32) gives a new control surface equation: 

Vk = vjfc.t + e k + e k + cr*V£' , (33) 

where V r k denotes unit-variance Gaussian noise. So the Kalman filter’s control output 
equals the sum of the three input variables plus additive Gaussian noise with time-dependent 
variance a\. For constant error e*, we can interpret (33) as a smooth control surface in Ft? 
defined by 


Vk = + Ck + c k , 
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and perturbed at time k by Gaussian noise with variance a\ . 

In our simulations the standard deviation o* converged after only a few iterations. We 
used unity initial conditions: P 0 \ 0 = 7Z*. = I for all k. 

Table I lists the convergence rates and steady-state values of a * for three difTeren- 
t values of the variance Var(w) of the white-noise, unmodcled-cfiects process Wk . For 
Var(xo) = 0, < 7 k decreases rapidly at first — <7g = *10, <*i7 — -05 — but does not attain 
its steady-state value of zero within 100 iterations. 


V r ar(u?) 

Steady-state 
value of Ck 

Number of iterations 
required for convergence 

1.00 

0.79 

2 

0.25 

0.46 

4 

0.05 

0.22 

9 


TABLE 1 Convergence rates and steady-state values of a* for different val- 
ues of the variance Var(w) of the white-noise, unmodeled-effects process to*. 


Figure 11 shows four realizations of the Kalman filter’s random control surface for 
e k = 0, each at a time k when cr* has converged to its steady-state value. For each plot, we 
used output thresholds and initial variances for the azimuth case: |u*| < 9.0, Rk = P Q \o 
= 1.0. As with the fuzzy controller, elevation control surfaces equal scaled versions of the 
corresponding azimuth control surfaces. 
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(a) 


(b) 




FIGURE 11 Realizations of the Kalman filter’s random control surface 
with cjt = 0 for different values of the variance Var(w) and steady-state values 
of the standard deviation <7*: (a) Kar(tx>) = <7* =0, (b) Var(w) = .05, 

a k = .22; (c) Var(w) = .25, a k = .46; (d) Var(w) = 1.0, c k = .79. 


SIMULATION RESULTS 


Our target-tracking simulations model several realworld scenarios. Suppose we have 
mounted the target tracking system on the side of a vehicle, aircraft, or ship. The system 
tracks a missile that cuts across the detection range on a straight flight path. The target 
maintains a constant speed of 1,870 miles-pcr-hour and comes within 3.5 miles of the 
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platform at c'oscst approach. The platform can scan from 0 to 180 degrees in azimuth at 
a maximum rate of 36 degrees- per- second, and from 0 (vertical) to 90 degrees in elevation 
at a maximum rate of 18 degrees- per- second. The sampling interval is 1/4 of a second* 
The gain of the fuzzy controller equals 0.9. So the maximum error considered is 10 degrees 
azimuth and 5 degrees elevation. We threshold all error values above this level. 

Figure 12 demonstrates the best performance of the fuzzy controller for a simulated 
scenario- The solid lines indicate target position. The dotted lines indicate platform 
position- To achieve this performance, we calibrated the three design parameters — upper 
and lower trapezoid bases and the gain. Figures 13 and 14 show examples of uncalibrated 
systems. Too much overlap causes excessive overshoot. Too little overlap causes lead or 
lag for several consecutive time intervals. A gain of 0.9 suffices for most scenarios. We 
can fine-tune the fuzzy control system by altering the percentage overlap between adjacent 
fuzzy sets. 

Figure 15 demonstrates the best performance of the Kalman-filter controller for the 
same scenario used to test the fuzzy controller. For simplicity, Rk — /o|o for all values of 
£. For this study we chose the values 1.0 (unit variance) for azimuth and 0.25 for eleva- 
tion- This 1/4 ratio reflects the difference in scanning range- We set Qk to 0 for optimal 
performance. Figure 16 shows the Kalman-filter controller’s performance when Qk = 1.0 
azimuth, 0.25 elevation. 


Sensitivity Analysis 


We compared the uncertainty sensitivity of the fuzzy and Kalman-filter control systems. 
Under normal operating conditions, when the FAM bank contains all fuzzy control rules, 
and when the unmodeled-effects noise variance Var(w) is small, the controllers perform 
almost identically. Under more uncertain conditions their performance differs. The Kalman 
filter’s state equation (26) contains the noise term whose variance wc must assume. 
When Var(w) increases, the state equation becomes more uncertain. The fuzzy control 
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FAM rules depend implicitly on this same equation, but without the noise term. Instead, 
the fuzziness of the FAM rules accounts for the system uncertainty. This suggests that we 
can increase the uncertainty of the implicit state equation by omitting randomly selected 
FAM rules. Figures 17 and 18 show the effect on the rool-mcan-squarcd error (RMSE) in 
degrees when we omit FAM rules and increase Var(xo). Each data point averages ten runs. 

The controllers behave differently as uncertainty increases. The RMSE of the fuzzy 
controller increases little until we omit nearly sixty percent of the FAM rules. The RMSE 
of the Kalman filter increases steeply for small values of Vdr(tu), then gradually levels off. 

We also tested the fuzzy controller’s robustness by “sabotaging” the most vulnerable 
FAM rule. This could reflect lack of accurate expertise, or a highly unstructured problem. 
Changing the consequent of the steady-state FAM rule {ZE, ZE , ZE ; ZE) to LP gives the 
following nonsensical FAM rule: 

IF the platform points directly at the target 

AND both the target and the platform are stationary, 

THEN turn in the positive direction with maximum velocity. 

Figure 19 shows the fuzzy system’s performance when this sabotage FAM rule replaces 
the steady-state FAM rule. When the sabotage FAM rule activates, the system quickly 
adjusts to decrease the error again. The fuzzy system is piecewise stable. 
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FIGURE 13 Uncalibrated fuzzy controller: (a) azimuth position and error, 
(b) elevation position and error. Fuzzy set overlap equals 33.3%. Too much 
overlap causes excessive overshoot. 
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FIGURE 14 Uncalibrated fuzzy controller: (a) azimuth position and error, 
(b) elevation position and error. Fuzzy set overlap equals 12.5%. Too little 
overlap causes lead or lag for several consecutive time intervals. 




FIGURE 15 Kalman filter controller with unmodeled-effects noise variance 
Var(w) = 0: (a) azimuth position and error, (b) elevation position and error. 









n.evATioN 


AUMUTW 0*0* *• TtMC 



FIGURE 16 Kalman filter controller with Kar(u>) = 1-0 azimuth, 0.25 
elevation: (a) azimuth position and error, (b) elevation position and error. 
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FIGURE 19 Fuzzy controller with a “sabotage” FAM rule: (a) azimuth pa- 
sition and error, (b) elevation position and error. The sabotage rule {ZE, ZE , ZE\ LP) 
replaces the steady-state FAM rule (ZE,ZE,ZE'ZE). The system quickly 
adjusts each time the sabotage rule activates. 







Adaptive FAM (AFAM) 


Wc used unsupervised product-space clustering [Kosko, 1990a] to train an adaptive 
FAM (AFAM) fuzzy controller. Differential competitive learning (DCL) adaptively clus- 
tered input-output pairs. The Appendix describes product-space clustering with DCL. For 
this study, there were four input neurons in F x . A manually-designed FAM bank and 80 
random target trajectories generated 19,236 training vectors. Each product-space training 

vector (e*, c k , t>k-i, v k ) defined a point in Ti 4 . 

Symmetry allowed us to reflect about the origin all sample vectors with negative errors 
c fc . We then trained 3,000 synaptic quantization vectors (p = 3,000) in the positive error 
half-space. For each sample vector, we defined the 10 closest synaptic vectors as winners 
( 1 V = 10). The matrix W of Fy within-field synaptic connection strengths had diagonal 
elements to,-,- = 2.9, off-diagonal elements w,j = -0.1. After training, we reflected the 
3,000 synaptic quantization vectors about the origin to give 6,000 trained synaptic vectors. 

The product-space FAM cells uniformly partitioned the four-dimensional product 
space. Each FAM cell represented a single FAM rule. The four fuzzy variables could assume 
only the 7 fuzzy-set values LN, MN, SN , ZE, SP, MP, and LP. So the product space 
contained 7 4 = 2401 FAM cells. 

At the end of the DCL training period, we defined a FAM cell as occupied only if it 
contained at least one synaptic vector. For some combinations of antecedent fuzzy sets, 
synaptic vectors occupied more than one FAM cell with different consequent fuzzy sets. In 
these cases we computed the centroid of the consequent fuzzy sets weighted by the number 
of synaptic vectors in their FAM cells. Wc chose the consequent fuzzy set as that output 
fuzzy-set value with centroid nearest the weighted centroid value. We ignored other FAM 
rules with the same antecedents but different consequent fuzzy sets. 

Figure 20(a) shows the e k = ZE cross section of the original FAM bank used to 
generate the training samples. Figure 20(b) shows the same cross section of the DCL- 
cstimated FAM bank. Figure 21 shows the original and DCL-estimated control surfaces 

for constant error e k = 0. 
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for constant error e* = 0. 

The regions where the two control surfaces differ correspond to infrequent high-velocity 
situations. So the original and DCL-cstimatcd control surfaces yield similar results. Table 
2 compares the controllers’ root-mcan-squarcd errors for 10 randomly-selected target tra- 
jectories. 
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FIGURE 20 Cross sections of the original and DCL- estimated FAM banks 
when e* = ZE: (a) original, (b) DCL- estimated. 
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FIGURE 21 Control surfaces for constant error et 0. (a) original, 

(b) DCL-estimated. 
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Trajectory Azimuth Elevation 


Number 

Original Estimated 

Original Estimated 

1 

2.33 

2.33 

3.31 

3.37 

2 

4.14 

4.14 

3.03 

2.89 

3 

6.11 

6.11 

3.69 

3.68 

4 

3.83 

3.83 

3.32 

3.30 

5 

4.02 

4.02 

3.11 

3.10 

6 

2.84 

2.84 

1.20 

1.21 

7 

3.22 

3.22 

3.04 

2.98 

8 

0.75 

0.74 

2.00 

2.00 

9 

9.28 

9.27 

5.50 

5.41 

10 

1.81 

1.81 

2.29 

2.29 

Average 

3.83 

3.83 

3.05 

3.02 


TABLE 2 Root-mean-squared errors for 10 randomly-selected target tra- 
jectories. The original and DCL-estimated FAM banks yielded similar results 
since they differed only in regions corresponding to infrequent high-velocity 
situations. 


Conclusion 


We developed and compared a fuzzy control system and a Kalman-filter control system 
for realtime target tracking. The fuzzy system represented uncertainty with continuous or 
fuzzy sets, with the partial occurence of multiple alternatives. The Kalman-filter system 
represented uncertainty with the random occurence of an exact alternative. Accordingly, 
our simulations tested each system’s response to a different family of uncertainty envi- 
ronments, one fuzzy and the other random. In general representative training data can 
“blindly” generate the governing FAM rules. 
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These simulations suggest that in many cases fuzzy controllers may be a robust, com- 
putationally effective alternative to linear Kalman filter, indeed to nonlinear extended 
Kalman filter, approaches to realtime system control— even when we can accurately artic- 
ulate an input-output math model. 
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Appendix: Product-space Clustering with 
Differential Competitive Learning 


Adaptive Vector Quantization 


Product-space clustering [Kosko, 1990a] is a form of stochastic adaptive vector quanti- 
zation. Adaptive vector quantization (AVQ) systems adaptively quantize pattern clusters 
in RJ 1 . Stochastic competitive-learning systems are neural AVQ systems. Neurons com- 
pete for the activation induced by randomly sampled patterns. The corresponding fan- in 
vectors adaptively quantize the pattern space /P 1 . The p synaptic vectors mj define the 
p columns of the synaptic connection matrix M . M interconnects the n input or linear 
neurons in the input neuronal field Fx to the p competing nonlinear neurons in the output 
field Fy . Figure 22 below illustrates the neural network topology. 

Learning algorithms estimate the unknown probability density function p(x), which 
describes the distribution of patterns in iZ*. More synaptic vectors arrive at more probable 
regions. Where sample vectors x are dense or sparse, synaptic vectors xxij should be dense 
or sparse. The local count of synaptic vectors then gives a nonparametric estimate of the 
volume density P{V) for volume V C iZ*: 


P(V) = l p(x)dx 

Number of m,- € V 
« 

P 


(34) 

(35) 


In the extreme case that V — if*, this approximation gives P{V) = p/p = 1 . For 
improbable subsets V , P[V) — 0/p = 0. 
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Stochastic Competitive Learning Algorithms 

The metaphor of competing neurons reduces to nearest-neighbor classification. The 
AVQ system compares the current vector random sample x(t) in Euclidean distance to the 
p columns of the synaptic connection matrix M , to the p synaptic vectors m,(0, •••- ™ p (t). 
If the jth synaptic vector m^t) is closest to x(t), then the jth output neuron “wins” the 
competition for activation at time t. In practice we sometimes define the nearest N synaptic 
vectors as winners. Some scaled form of x(<) - m j(t) updates the nearest or “winning” 

synaptic vectors. “Losers” remain unchanged: m.(t + l) = Competitive synaptic 

vectors converge to pattern-class centroids exponentially fast [Kosko, 1990b]. 

The following three-step process describes the competitive AVQ algorithm, where the 
third step depends on which learning algorithm updates the winning synaptic vectors. 

Competitive AVQ Algorithm 


1. Initialize synaptic vectors: m,(0) = x(:'),i = !,•••>?• Sample-dependent initial- 
ization avoids many pathologies that can distort nearest-neighbor learning. 


2. For random sample x(t), find the closest or “winning” synaptic vector 

IK(0 - x(t)|| = m]n||mi(0 - x(Q|| , (36) 

where ||x|| 2 = x\ + ... + z 2 defines the squared Euclidean vector norm of x. We 
can define the N synaptic vectors closest to x as “winners. 


3. Update the winning synaptic vector(s) mj(t) with an appropriate learning algorithm. 
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Differential Competitive Learning (DCL) 

Differential competitive “synapses" learn only if the competing “neuron changes its 
competitive status [Kosko, 1990c]: 

rhij = Sj(yj)[Si(xi) — m,*j ] , ( 37 ) 

or in vector notation, 

rn; = Sjiyj) (S(x) - m;] , (38) 

where S(x) = (S l (x l ) 5 n (x n )) and m, = m {j denotes the synaptic 

value between the »th neuron in input field Fx and the jth neuron in competitive field 
F Y . Nonnegative signal functions Sj and Sj transduce the real-valued activations x,- and 
yj into bounded monotone nondecreasing signals S,(x,) and Sj(yj). rhjj and Sj(yj) denote 
the time derivatives of mj and 5,(y i ), synaptic and signal velocities. Sjfaj) measures the 
competitive status of the jth competing neuron in Fy. Usually Sj approximates a binary 
threshold function. For example, Sj may equal a steep binary logistic sigmoid, 


Sj(yj) 


1 

1 + ’ 


(39) 


for some constant c > 0. The jth neuron wins the laterally inhibitive competition if 


Sj = 1, loses if Sj = 0. 

For discrete implementation, we use the DCL algorithm as a stochastic difference 
equation (Kong, 1991]: 


mi (t + 1) = m ,-(*) + ct AS i (y j (t))(5(x(<)) - m,(t)] if the jth neuron wins, (40) 
m,(t + 1) = m,(f) if the ith neuron loses. ( 41 ) 

ASj(yj(t)) denotes the time change of the jth neuron’s competition signal Sj(y,-) in the 
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competition layer Fy- 


ASj(yj(0) = + 1)) - Sj(yj(0)] • 


(42) 


We define the signum operator sgn(x) as 


sgn(x) 


1 1 if x > 0 

0 if i = 0 

—1 if i < 0 


(43) 


{cj denotes a slowly decreasing sequence of learning coefficients, such as c t = -1(1 - 
1/2000) for 2000 training samples. Stochastic approximation [Huber, 1981] requires a de- 
creasing gain sequence {c,} to suppress random disturbances and to guarantee convergence 
to local minima of mean-squared performance measures. The learning coefficients should 


decrease slowly, 


X> = 00 ’ 

t=i 

but not too slowly, 


(44) 


< 00 


«=i 


(45) 


Harmonic-series coefficients, c« — l/f, satisfy these constraints. 

We approximate the competitive signal difference A Sj as the activation difference Ay,. 


A SMt)) = sgn{ yj (t + l) - y;(f)l ( 46 ) 

= Ay,(0 • ( 4? ) 

Input neurons in feedforward networks usually behave linearly: Sj(n ) = i,-, or S(x(t)) = x(t). 
Then we update the winning synaptic vector m j(t) with 
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( 48 ) 


:f> mj(t + 1) = rrij(i) + d Ayj(OMO - «*i(01 • 

We update the Fy neuronal activations r/j with the additive model 

yj(t + 1) = yj{t) + ^5i(ii(i))mi,(t) + 53 s k(yt(t))w k j . (49) 

For linear signal functions 5,-, the first sum in (49) reduces to an inner product of sample 
and synaptic vectors: 

= * T (*W0 • ^ 

* 

Then positive learning tends to occur— Amy > 0— when x is close to the jth synaptic 
vector rrij. 

Since a binary threshold function approximates the output signal function S*(y* ), the 
second sum in (49) sums over just the winning neurons: 53 w *i ^ or ^ winning neurons y* . 

The p x p matrix W contains the Fy within-field synaptic connection strengths. Di- 
agonal elements w« are positive, off-diagonal elements negative. Winning neurons excite 
themselves and inhibit all other neurons. Figure 22 shows the connection topology of the 
laterally inhibitive DCL network. 
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INTRODUCTION 


B SS Freedom is a highly variable system which requires a 
general, robust control system 

© Mass properties vary orders of magnitude during 
assembly 

9 Vehicle orientation for normal operations changes 
significantly during assembly 


■ Operational environment 

© Disturbances typically 0-2 times orbit frequency 

— Aerodynamic, gravity gradient, gyroscopic torques 
e Sensors sampled at 5 Hz, effectors commanded at 2.5 Hz 


H Vehicle is controlled using two different systems 
• CMG's (Control Moment Gyroscopes) 

© RCS (Reaction Control System) 

I 

s r . 
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HIGHLY DYNAMIC PLANT 

H Vehicle changes significantly after each assembly stage 
® Mass properties variations 

— Mass varies from 60,000 - 800,000 lb 

l J 

— Center of Mass (cm) location moves over 1 00 ft. 

— MOI's (Moments of Inertia) vary by 2 orders of 
magnitude 

— Delta MOI's (Ixx - Izz etc) can change sign during 
planned operations resulting in the gravity gradient 
torque derivatives changing sign 


e RCS system variations 

— Number and location of thrusters changes 
depending on assembly stage 

— Blowdown ACS thrust varies from 25-9 Ibf. 

— Reboost varies from 50 - 20 ibf. 
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HIGHLY DYNAMIC PLANT (cont.) 

B! Mass properties change significantly during each assembly 
phase 

® Orbiter docking adds approximately 220,000 lb and 
causes significant changes in cm and MOI's 

© Arm motion with heavy payload attached causes 
continually varying mass properties during operations 


B Vehicle orientation during normal operations changes 
g during assembly flights 

© Assembly flights 1-6 


— Nominal attitude is gravity gradient stable with the 
truss aligned with the local vertical 


— During reboost 'Arrow' orientation is maintained with 
the truss aligned with the velocity vector 

© After assembly flight 6 vehicle maintains TEA (Torque 
Equilibrium Attitude) during normal operations, LVLH 
(Local Vertical Local Horizontal) during reboost 
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SS FREEDOM FLIGHT ATTITUDES 

♦-MB 



Velocity 


Gravity Gradient Orientation 



Arrow Orientation 


Nadir 


Velocity 



Normal Orientation 

— Space Station Freedom • ge 

Jeff Penrod 1 1/13/90 ADCS Pilch lot Fuzzy Logic Workshop 


Honeywell • IBM 


Lockheed 


5 


EFFECTORS 


B CMG (Control Moment Gyroscopes) 

© Dual Gimbal, constant speed rotors store angular 
momentum (3500 ft-lbf-sec each) 

» Provide torque to the vehicle by changing the net 
angular momentum vector of the CMG(s) 

® Linear actuator 

© Relatively small angular momentum storage 
capacity (4 CMG's in current design) 


■ RCS (Reaction Control System) 

© Uses small, rocket thrusters to provide vehicle 
attitude control & reboost 

© Requires consumable propellant 

• Non-linear actuator 
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SENSORS 

SI Inertial Attitude Sensors 

o ISA (Inertial Sensor Assembly) 

— Three axis ring laser gyroscope 

I 

— Provides body rate information 

— 3 ISA's on the Attitude Reference Assembly 

® Star Tracker 

— Provides inertial attitude based on star catalog 
— Software provides 'deadstart' capability 

— 2 star trackers on Attitude Reference Assembly 

■ CMG angular momentum measured via sensed gimbal 
angles 
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CONTROL SYSTEM 
PERFORMANCE REQUIREMENTS 

H Attitude control 

9 TEA must be within ± 5° of LVLH (currently not 
doable) 

© Attitude variations from TEA of less than 2.5°/orbit 


Minimize propellant consumption during program lifetime 

© Requires a CMG momentum management system 

— Manages CMG momentum using gravity gradient 
torques 

— Can fly TEA and consume no propellant 
e RCS must use minimum propellant 

— TEA seeker minimizes propellant consumption 
— Use of fuel optimal jets for every firing 
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CONTROL SYSTEM 
FUNCTIONAL REQUIREMENTS 


FUNCTION 

CMG 

RCS 

COMMENTS 

Primary Attitude Control 
(Normal operations) 

X 


Orbit at TEA using momentum 
manager 

Backup Attitude Control 


X 

Orbit in TEA seeker mode 

Attitude Maneuvers 


X 

CMG's in reset mode 

Reboost attitude control 

X 

X 

CMG's in reset 

Large Transient 
Disturbances 

X 

X 

Cooperative CMG/RCS control - 
RCS assists CMG's to prevent 
saturation 

Adequate Flex Stability 
Margin 

X 

X 

No active damping of structural 
vibrations. Controllers must 
not excite significant flex-body 
modes. 

LVLH Attitude Hold 

x^ 

X 


Inertial Attitude Hold 

X 

X 


iFailure Accomodation 

X 

X 

CMG controller must handle 
failed CMG(s) 

RCS must handle failed 
thruster(s) 
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Gtmbaf 

Angles 
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CONTROLLER OVERVIEW 

B Momentum Manager/CMG Controller 

9 Maneuvers the vehicle to generate time-varying gravity 
gradient torques to manage the CMG momentum and thus 
use no consumables 

e Gravity gradient torques about roll and pitch axes only. 
Yaw momentum must be dissipated via roll maneuvers 1/4 
orbit after momentum buildup occurs 

• Low Bandwidth (poles are .3-10 times orbit frequency), 
continuous controller 


■ RCS Controller 

i 

• Generates control torques using pre-processed fuel optimal 
sets of jets 

e 50 millisecond minimum on-time 

e Bang-off-bang controller with variable phase plane 
parameters 

B Structural flex-body mode filters used 
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SUMMARY 

H Robust, multi-variable stable control system is required 
for SS Freedom attitude control due to dramatic 
variations of the vehicle mass and aerodynamic 
properties 

B CMG controller requires a guidance momentum 

management algorithm so no consumable is required 
during normal operations 

8 1 RCS system must minimize propellant consumption by 

using sets of fuel optimal jets for maneuvers 

B Both systems must be fault tolerant and operate with 
failed components (thrusters and individual CMG's) 

H Multiple opportunities for fuzzy logic controllers, 
particularly the RCS if fuel use can be reduced below 
current levels 
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BLOWDOWN THRUST PROFILE PREDICTION 

Kelly D. Murdock 
(Continued) 


INTRODUCTION 

• Space Station Freedom propulsion system consists of a blowdown 
(non-constant thrust) hydrazine system. The thrust depends on the 
tank pressure which "blows down" as the thrusters are fired. 

• The station is periodically reboosted to maintain orbital lifetime and 
reduce orbital eccentricity. Due to the low thrust to mass ratio 
available, typical reboost maneuvers can require hours of 
continuous thrusting. 

o Computation of the burn on/off times for a reboost require accurate 
prediction of the thrust profile for the length of the burn. 

o Computation of the burn on/off times onboard require a means of 
generating a predicted thrust profile without resorting to a 6-dof 
simulation. 

® Prediction of the thrust profile is complicated by the following: 

— Thruster cycling to maintain attitude control. 

— Both reboost and attitude control thrusters are cycled for 
attitude control depending on the relative thrust miss-match on 
the modules. 
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Kelly D. Murdock 
(Continued) 


h Introduction (continued) 

— Thruster cycling is frequency limited due to structural 
constraints. 
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BLOWDOWN THRUST PROFILE PREDICTION 

by 

Kelly D. Murdock 
(Continued) 


Typical Total Thrust Profile With 
Thruster Cycling & 
Different Initial Tank Pressures 
on Each of the 4 Modules 



TIME 
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BLOWDOWN THRUST PROFILE PREDICTION 

Kelly D. burdock 
(Continued) 

Propulsion Module Geometry 
Attitude Control Module Reboost Module 



Reboost Module 


Space Station Freedom 


□ 



CG 



Attitude Control Module 
(Primary) 


McDonnell Douglas • GE • Honeywell • IBM • Lockheed 


1 1/7/90-000-6 


Aulhor: 


Filename: 




BLOWDOWN THRUST PROFILE PREDICTION 

by 

Kelly D. Murdock 
(Continued) 


■ Solution Approach 

o The current solution approach seeks to determine an 
approximation to the average thrust curve representing the 
blowdown thrust profile. The curve is smooth and does not contain 
the spikes associated with thruster cycling. 

® The algorithm for determining the thrust curve runs as follows: 

— Determine whether attitude can be maintained by pulsing 

attitude control jets only with both reboost jets on full or whether 
one reboost jet must be cycled with the other reboost jet on full. 
This can be determined by considering the geometry. 

— Select a burn duration for the full-on reboost jet. 
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BLOWDOWN THRUST PROFILE PREDICTION 

Kelly D. Murdock 
(Continued) 

h Solution Approach (Continued) 

— Form the equation for the static moment of the two reboost and 
single attitude control module. This provides two equations 
(one each in pitch and yaw) in two unknowns (scale factors on 
the burn times of the attitude control module and the reboost 
module that has the pulsing jet). Mathematically this is 
expressed as: 

T 

|{ r i x ^(t)+r 2 xfj(at)+r 3 xfj(/J t)jdt = 0 
o 

where the i; are the position vectors (relative to the truss center) of th< 
full on reboost module, the pulsing reboost module and the attitude 

control module respectively. The f are the thrust vectors of the 

respective modules (all in the +X body direction) and the ol and p are 
time scale factors. 

— Solve the above system of equations for the time-scale 
constants. 
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BLOWDOWN THRUST PROFILE PREDICTION 

Kelly D. burdock 
(Continued) 

— Iteration on the burn time for the full-on module provides time 
scale factors for the other two modules over the length of the 
reboost. 

— The total thrust profile as a function of time is then given by: 

Thrust(t) = fj(t)+^(a t)+ tj(/3 1) 0<t<T 
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BLOWDOWN THRUST PROFILE PREDICTION 

by 

Kelly D. Murdock 
(Continued) 

0 Limitations of Current Approach 

© Although full numerical evaluation of the algorithm has not yet been 
completed the following points can be made: 

— Tne predicted thrust curve is more accurate towards the end of 
the reboost time T than it Is at the beginning. This is a drawback 
since the predicted curve is used for maneuver performance 
monitoring as well as targeting. 

— The thrust profile is also more accurate in predicting the 

integrated thrust the longer the time span chosen. Once again 
though, the accuracy of the curve near the start of the burn is 
reduced. 
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BLOWDOWN THRUST PROFILE PREDICTION 

Kelly D. burdock 
(Continued) 


b Summary 

® A means of generating an estimate of the total thrust curve 

encountered during a reboost using a blowdown propulsion system 
has been developed. 

• The algorithm is straight forward and does not involve a large 
amount of code. 

a Question for Panel Discussion: 

a Can a fuzzy logic algorithm be developed that would provide a 
thrust profile curve that would predict the Integrated thrust of the 
propulsion system over time spans of a few hundred seconds 
rather than over 1000's of seconds with equal accuracy over all 
regions of the curve? 
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Blowdown Thrust Prediction 
Butch Stegall 

(Stegall) Environment on the ground is worse than in space. They currently 
have an analytical math model (running in Fortran and Ada). GN&C 
experts are available at JSC, Marshall, JPL, etc. 

- Highly dynamic system during assembly & operation - opinion is that this 
is a good area for uncertainty management 

- The largest criteria for deciding which method to use is the minimization of 
the code size. 

(Stegall) What can be done? Current algorithms are simple, but they are 
approximations - large amount of uncertainty and many combinations 

Why is source reduction a goal? 

$450. per line of code for development for manned flight software systems; 
Large life cycle costs; 30 year program (SSFP); software maintenance 

Over suite of combinations, is it still feel optimal? 

Yes, 98% optimal. 

If fuzzy logic came up with an algorithm to match curve (see figure from 
presentation of "typical" thrust profile with thruster cycle), how much 
precision will they gain? 

Don't know; full blown Monte Carlo simulations have not been run. This is 
not a "large” software application - contains less than 40 lines of code. The 
tradeoff is in performance and MIPS. 

What is the value added? 

in MIPS - any reduction in MIPS is a value. Right before re boost, they are 
predicting crunch (reboost — > every 90 days). 

Reboost case is a long-term high feel utilization. 

Why can’t this be done on the ground? 

Zone of Exclusion, tank management, attitude control - need to be onboard 
in order to run closed loop and to deal with e r rors. 

On control system, what kind of sensitivity studies have been done and 
what will the benchmarking be done against? 

5 out of 21 Shuttle flights are being looked at in detail for standardized set 
of disturbances; The main concentration is using analytical verification. 
Example: Verified shuttle aero-variables have some range. In test and 
verification, GN&C does Monte Carlo simulations; destructive testing, 
trying to break it 

There is a good deal of work on phase plane control attitutde using forty for 
attitude hold. Also, we have used fuzzy logic on pre-editing of filtering rate 
attitude data from sensors (sensor data preprocessing). 

On the attitude control we are still testing but have seen a significant 
decrease in fuel usage (over 1/3) for an attitude hold. Propellant 
consumption is propulsion metric. 

If the flight control system is controlled on the helicopter, you have also 
succeeded in controlling Space Station (less complicated control sequence). 
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Rendezvous Guidance 
Andy McGuire 

The LQT assumptions - which one can you make with confidence? 

(Lea) What fuzzy gain functions don't require r eini tial iz a ti on. 

A candidate is to attack the drawbacks. 

(McGuire) The software is still in preliminary design phase. 

(Berenji) observation - no restriction combining fuzzy logic with detailed 
domain model; use the fuzzy lope application as a high level controller. 
Possibility — > use fuzzy logic for doing re in i ti aliza ti on. 

Gain — > Adaptability, flexibility 

How "bad” off are they? Computational? i.e. can traffic control use it’s 
own SDP; what’s throughput; sizing problem? What are the metrics? [All 
systems need to answer this]. 

Fuel Performance. Run against performance using existing information. 
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b Outline 

e Introduction 

o Requirements & Constraints 
e Problem Formulation 
e Proposed Approach 
0 Summary 
e Panel Discussion 
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PROXIMITY OPERATIONS 

( INTRODUCTION 

b Proximity operations encompasses all free-flying vehicle relative 
motion within 1 km radius sphere of the Station, the proximity 
operations zone (POZ) 

■ U.S. efforts traditionally include manual piloting of an active chase 
vehicle about a passive target 

b Primary active vehicle Is the Shuttle 

• Greatest effects on Station components and operations 
9 Highest frequency of interaction 

£ b Station era may involve unmanned cooperative vehicles 

• Potential candidates for automated flight 

— Man-Tended Free-Flyer (MTFF) - currently plans Station visits 
— Assured Crew Return Vehicle (ACRV) 

— Flight Telerobotic Servicer (FTS) 

9 Remote manual piloting from Station cupola or ground 
— Shuttle- and Station-based OMVs / OTVs 
— Crew Equipment Retrieval System (CERS) 

— Flight Telerobotic Servicer (FTS) 

b Direct influences on system design, SE&I and operations 
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PROXIMITY OPERATIONS 

. TASK REQUIREMENTS & CONSTRAINTS 

0 Flight techniques / procedures development accounts for 
® Lighting / visibility constraints 
® Trajectory and attitude control 
e Plume Impingement & environment effects 

• Docking / berthing contact conditions 

• Structural clearances 
o Contingency planning 
© Crew timelines 

© Ground rules 

• Fuel usage 

■ Flight performance directly dependant on 

• Flight techniques development and piloting skill 

• Control system authority, capacity and performance 
© Propulsion system functionality and effectiveness 

© Relative navigation sensor accuracy and precision 
® Orbital environmental effects 

Space Station Freedom Mcoonma douqim • qe • HomywSi • bm • L<x*tw«d 


1 \wim rn iuTQ 


I1/9/W- p*|* -3 


Author. Dundt Rhode* 


Fiknww Fuuy U|k/fn>i Op* fo» 33F 



PROBLEM FORMULATION 

Control task is regulating the six degree-of-freedom (DOF) relative 
motion between vehicles to achieve the desired trajectory 

• Chaser performs translational and rotational maneuvers 
e Target drifts or actively maintains an attitude profile 
® Critical flight parameters wrt relnav sensor line of sight (LOS) 

Traditionally, flight profile manually flown by refined procedures - 

© Relative state control Is split into three distinct aspects: 

— Rotational attitude ana attitude rates 

— Range, closing or opening velocity 

— Cross range, bearing angles & rates 

» , e MOTS Tralftr lory Relative to Station 

Vbar approach 
as example 
trajectory - 
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PROBLEM FORMULATION 

(CONTINUED) 

a Flight parameter flow / pilot interaction for proximity operations task 


Jet On/Off 
Commands, 
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Jet Selection 
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Pilot tasks: Execute 
timeline, Monitor 
avionics data, 
Evaluate firing need 


Observe Trends 
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PROBLEM FORMULATION 

' (CONTINUED) 

□ Rotational state (3 DOF) automatically maintained by attitude 
determination / control and pointing systems 

• Command activation as a function of time and / or position 


a Piloting task centers on execution of RCS translational firing s (3 DOF) 

e Range rate flown as 
function of range / time, 
the relation may be 
— Simply linear (see plot) 

— Based on non-linear 
empirical data 

e Gate boundaries sized 
to subject vehicle and 
desired profile tightness 

9 Firing Decision Logic 
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PROBLEM FORMULATION 


® Cross range flown as 
function of LOS bearing 
— Translational burns 
* normal to LOS 
— Data from CCTV, COAS f 
relative nav avionics 

© Angle boundaries sized 
to subject vehicle and 
desired profile tightness 

• Firing Decision Logic 
independant for azimuthal 
and elevation parameters 
in each zone 
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SUMMARY 

b Techniques exist that model, augment, automate prox ops piloting 

Q Overall task requires flexibility for broad application and poses 
multiple requirements constraints 

a Automation may be applied to specific aspects of the prox ops task 

b Traditional simulation paper pilots are tuned for their environment 

® Contributing vehicle factors: 

— Digital autopilot (DAP) / RCS configurations 
— Propulsion system characteristics 
— Sensor data quality 

a Tuning parameters: 

— Frequency of response 
— Number of input Impulses per response 
— Filtering and / or trend evaluation of the sensor data 

b Could fuzzy logic provide a way to develop generic automatic flight 
control applicable to various active vehicles for prox ops? 
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Proximity Operations 
Andy McGuire 

Work has been done during the last two years on automatic flight control 
with a demonstration in 1988. — > Rotational Controller containing 31 
rules. 
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RENDEZVOUS GUIDANCE 

BY 

ANDREW T. MCGUIRE 


Introduction 

• Space Station onboard software provides maneuver commands 
to cooperative unmanned vehicles attempting to rendezvous. 

9 Constraints affecting rendezvous include, station safety, fuel 
consumption, time limitations, etc. 

• Several targeting algorithms may be employed to obtain the 
relative guidance maneuver commands. 

9 Two of these targeting algorithms will be addressed. 

Lambert Targeting (point to point guidance). 

— Linear Quadratic Targeting ft-QT) (closed loop guidance). 
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RENDEZVOUS GUIDANCE 

BY 

ANDREW T. MCGUIRE 

n Problem Formulation 

e Onboard software responsible for unmanned vehicles in the 
Command and Control -Zone (CCZ). 
m CCZ dimensions: 12 km radially, thickness of 8 km 

9 The rendezvous maneuver brings the vehicle to a holding point at 
the edge of the proximity operations zone (POZ). 

9 POZ dimensions: 1km sphere centered at the Station. 
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RENDEZVOUS GUIDANCE 

BY 

ANDREW T. MCGUIRE 


• A generic rendezvous scenario in LVLH coordinates. 
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BY 

ANDREW T. MCGUIRE 


■ Proposed Approaches 

® Lambert Targeting Solution 

o Relative guidance solves the rendezvous targeting error function 
for zero. S(x)=f c ( x;t)-f t (/)= 0 

— f t (t) is the target state at the rendezvous time t, f c (x;t) is the 
rendezvous vehicle state. 

— x is the control vector 



where AV\ and AV2 are the impulsive maneuver burns 




— The vector prediction function is defined as, f(x;t)= 



where 


as R and V are the inertial position and velocity vectors of the 
vehicle performing the rendezvous at time t. 

— f evaluated with a predictor and S(x) with Newton's method. 


Lambert Targeting only satisfies the end conditions. 
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RENDEZVOUS GUIDANCE 

BY 

ANDREW T. MCGUIRE 

d Proposed Approaches (cont.) 

® Linear Quadratic Targeting (LQT) Solution 
* The LQT scheme is a closed loop optimal control problem, 
e Forces the system to track a desired trajectory over a given time 
interval. 

® Using the Clohessy-Wiltshire equations our system is modelled 

as: x k+1 = Ax k +Bu k , k>i ,with system output being y k = Cx k . 

® It is desired to make the output state follow a desired reference 
state rk over a time interval [0,N] so the cost function can be 
minimized. 

Jr\(yn-r n ) T P(yn-r n )+l £ [(y*-oO r <2(y*-^ )+«[*«*] . 

2 L k=i 

O x is the system state, u is the control, and the weighting matrices 
are P>0, Q>0, R> 0, with all three being symmetric. 
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RENDEZVOUS GUIDANCE 

BY 

ANDREW T. MCGUIRE 


Proposed Approaches cont. 

• The reference trajectory Is the desired rendezvous trajectory. 

® The weighting matrices, are user specified. 

— P weights the terminal state values, Q weights the state 
trajectory values, and R weights the control values. 

• By manipulating the weighting matrices you can sculpt the 
resulting trajectory to fit endpoint dispersion constraints, fuel 
consumption constraints, etc. 

• Advantage over Lambert targeting 

— Desired trajectory can be arbitrary. (Can be contrary to orbital 

dynamics) 
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RENDEZVOUS GUIDANCE 

BY 

ANDREW T. MCGUIRE 


h Summary 

© Lambert Targeting results in fairly high end-point dispersions . 

o Can reduce dispersions by incorporating mid-course correction 
burns. 

© Lambert Targeting is bound to orbital dynamics during the coast 
phase of the maneuver. 

• LQT can significantly reduce endpoint dispersions with little or no 
additional fuel consumption. 

© LQT can follow any reference trajectory desired regardless of 
orbital dynamics involved. 

© The LQT weighting matrices must be reinitialized with each new 
reference trajectory in order to perform optimally. 

• Fuzzy Logic Control has been discussed as being potentially 
applicable to the rendezvous guidance control. 

e (Opening question for Panel discussion) 

Can Fuzzy Logic control offer any advantages over LQT in 
computational simplicity, or ability to eliminate weighting matrix 
reinitialization. 
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Problem Statement 

Motion planning for redundant robots in a constrained 
environment 


Current Approaches 
tf Model Based 
Sensor Based 
£ Hybrid 
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PLANAR MODEL 


Task Space 

Y 



Join Angle Space 









Model Based Path Planning 
° Uses CAD model (a priori knowledge) 

° Transformations done offline 
° Uses large granularity for efficiency 
° Large search space (exponential in DOF) 

° Environment must be static (i.e. no humans) 

Sensor Based Path Planning 
° Detect obstacles before collision 
° Non-optimal path (may wander) 

° May have very high degree of sensor redundancy 
° Sensors usually located on robot (work in robot space) 
Hybrid Path Planning 
° Best of both worlds 

Requires fusion of model and sensor information 


o 
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APPLICATIONS FOR FUZZY LOGIC 

• Model based 

° No closed form solutions for redundant manipulators 
0 Large search space 
0 Interpolations between tessellations 

• Sensor based 

° Combine redundant information 
° Can calculate approximate range and size of obstacles 
° Optimal path between 2 obstacles 

• Hybrid 

° Same as model and sensor 
° Resolving conflicts between model and sensor data 
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■ Outline 

• Introduction 

• Problem Formulation 
o Proposed Approaches 

• Simulation Demonstration 
9 Summary 

• Panel Discussion ^ 
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ACTIVE DAMPING IN A FLEXIBLE MANIPULATOR 

by 

Trung T. Pham 
(Continued) 


B INTRODUCTION 

• The Shuttle Remote Manipulator System (SRMS) is a highly 
flexible dynamical structure which results in vibration in its links, 
most commonly seen at the end-effector. 

• The vibration is caused by several factors: deformable material 
used for construction of the links, non-rigidity of the brakes and 
gears at the joints, characteristics of the controllers of the joint 
servos. 

• In this report, we will address the following: 

(i) Modeling of a flexible manipulator dynamical structure 

(ii) Designing control law criterion that minimizes vibration 

(iii) Candidate Application of Fuzzy Logic Control Law to the 
Problem 
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ACTIVE DAMPING IN A FLEXIBLE MANIPULATOR 

by 

Trung T. Pham 
(Continued) 


M PROBLEM FORMULATION 

• A point mass in vibration is governed by the equation of motion: 
Ma + C v + Kr = f 

where M Is the mass, K the stiffness, C the damping, f the external 
force, r the displacement, v the rate of displacement, and a the 
rate of v 



• A classical approach in formulating a long flexible rod is to treat 
the rod as a set of small segments, each representing a point 





ACTIVE DAMPING IN A FLEXIBLE MANIPULATOR 

by 

Trung T. Pham 
(Continued) 

B PROBLEM FORMULATION (cont.) 

• Control Laws: 

min J(q,u) (j is the cost function) 

s.t. 

q = f(q) + g(q) T (the equation of motion) 

E| 3 2 u» _ 3 2 U| _ HT v 

Pi 3xp 3t 2 " 1 ,q ' (the ec luation of vibration) 

where q is the state of the manipulator, u the vibration, T the joint 
torque vector, Ej the Young's modulus, Pi the mass density, and 

X| the position on link i with respect to joint i. 
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ACTIVE DAMPING IN A FLEXIBLE MANIPULATOR 

by 

Trung T. Pham 
(Continued) 

H PROPOSED APPROACHES 

o Definition of sensor data; type, rate: The followings are assumed 
provided by external sensors: state (Joint angles and joint angular 
velocities), joint positions, mass of payload; and by analysis: 
equation of motion of the manipulator, equation of vibration 
* Definition of positive control authority: The manipulator is put 
into motion by the joint torques. There are limitation in the amount 
of joint torques, joint angles, and joint angular velocities 
e Formulate the Control Criteria: minimizing vibration, minimizing 
response time, minimizing error & error rate, minimizing energy 
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ACTIVE DAMPING IN A FLEXIBLE MANIPULATOR 

by 

Trung T. Pham 
(Continued) 

rn PROPOSED APPROACHES (cont.) 

© It can be shown that the bang-bang control is one of the most 
efficient treatment of the previously defined optimal control problem 

if v(q,u) < D then T = Tmax 
else T = Tmin 

© Since u is an estimation of the vibration, one can update this model 
by camera obsevation data, with some relatively confident factor p. 
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ACTIVE DAMPING IN A FLEXIBLE MANIPULATOR 

by 

Trung T. Pham 
(Continued) 

B SIMULATION DEMONSTRATION 

9 This simulation illustrates the following concepts: 

(i) Flexible Model of a Long Rod 

(ii) Non-Rigid Model of a Joint Brake 

(iii) pid Controller of a 1-Link, 1-DOF Flexible Manipulator 
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ACTIVE DAMPING IN A FLEXIBLE MANIPULATOR 

by 

Trung T. Pham 
(Continued) 


m SUMMARY 

e Techniques to modei the flexibie dynamics of a manipulator have 
been identified 

o Control Criteria (specifications) for motion control of the flexible 
manipulator have been formulated 

• Fuzzy Logic Control Law has been discussed with application to 
the Shuttle Remote Manipulator System 

• (Opening question for Panel discussion) 

Given the sensor information and the control criterion, can Fuzzy 
Logic offer an advantage in computational simplicity, and what 
approach would you recommend, eg. additional sensory 
information, sensor fusion, and feedback control. 
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Active Damping in a Flexible Manipulator 
Trung Pham 


(Sugeno) To apply fuzzy logic, should not use feed forward because this 
system should include time data. Feedback is not so good if there is a time 
delay. 

(Pham) Would be interested in comparing these two approaches. 







i 


TETHERED SYSTEMS CONTROL 

f MDSSC-SSDeb 


OUTLINE 

B Introduction 
H Problem Formulation 

M Proposed Approaches 

© Controller Structure 
© Proposed Controllers 

B Simulation Examples 

9 Deployment 
9 Retrieval 

m Summary 



t 


i 

i 


j 


Dan Nowlan 
Specialist - GN&C 
Advanced Flight Systems 
(714) 896-1418 


i 


N93-31 453 


TETHERED SYSTEMS CONTROL 


is 


> MDSSC-SSDi 


S3 Introduction 
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Generator 


@ Tethers can provide 

- Momentum exchange 

- Mechanical/electrical conversion 

- Electrical/mechanical conversion 

• Technology applications 

- Acceleration environment control 

- Payload transportation 

- Electrical power generation 

- Attitude and orbital control 



il Relevance 


Problem Overview 


e Project applications 

- Atmospheric science research 

- Payload boost/deboost 

- Spacecraft power generation 

• Advantages 

- Data gathering 

- Application alternatives (Safety) 

& NASA near term activities 

- Delta ll/SEDS flight experiment 

- STS/Tethered Satellite System 


o Operational phases 

- Deployment, retrieval 

- Stationkeeping 

® Dynamics 

- Nonlinear, time-varying, coupled 

- Unstable, elastic, uncertain 

9 Performance criteria 

- Libration magnitude 

r- Deployment/retrieval time 

- Payload disturbances 
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PROBLEM FORMULATION 

Rigid body simplifications Subsatellite 

9 Point masses (Station and subsatellite) 
o station mass » Subsatellite mass 
o Massless, rigid tether 
e Spherical earth 

o Circular orbit Earth 



Station 
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H Observations 

o Dynamics are nonlinear (trig, products of states) 
o Retrieval dynamics involve negative libration damping 
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PROPOSED APPROACHES (CONTROLLER STRUCTURE) 
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m Feedback control 
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PROPOSED APPROACHES (PROPOSED CONTROLLERS) 

S Quadratic optimal nonlinear controllers 
© Tension Optimal Nonlinear Controller 

- Newton-Raphson, steepest descent 

- Divergence (explicit feedback, tension delay) 

e Length Rate Optimal Nonlinear Controller (LRONC) 

- Steepest Descent 

- Direct damping control 

o Suboptimal Nonlinear Controller (SONC) 

- Feedback structure (gain optimization) 

- Powell's Method 

Eg Lyapunov-based nonlinear controllers 
e Mission/distance function concept 
o Mission Function Control (MFC) 
e Lyapunov Optimal Feedback Controller (LOFC) 

m Sensor/actuator options 

® Measurements - length, tension, deployment attitude, P/L accels 
o Actuators - spring ejection mechanism, reel, thrusters 
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SUMMARY 


m Tethered systems have many potential applications 

m Tether dynamics encompass typical spacecraft control issues 
(stability, nonlinearities, coupled dynamics) 

M Tether control improvements could provide benefits in such areas 
as retrieval stability and mission timelines 


e Question - Can fuzzy logic control techniques help with the 

tethered systems control problem ? 


Topic: Teihercd Systems Control 

Presenter: Dan Nowlan 


No notes were taken during this presentation. 
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HYPERBARIC TREATMENT 


by 

Michael T. Amoroso 
(Continued) 


fl OUTLINE 

e Introduction 
o Problem Formulation 
§ • Proposed Approaches 

® Summary 
• Panel Discussion 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


9 INTRODUCTION 

• Hyperbaric Treatment - Purpose 

e Decompression sickness - Description 
e Sources of decompression sickness 

• Physical description 

® Forms of decompression sickness 

• Hyperbaric treatment of decompression sickness 
e Duration of treatment 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


■ PROBLEM FORMULATION 

o Determination of duration of hyperbaric treatment 

® Decision points in determining the duration of treatment 

® Relationship of exhaled breath gas composition to decompression 
sickness 

e Required equipment to monitor inert gases in exhaled breath 
q Space Station unique circumstances 
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Diagnosis: 

Dtcomprtssion 


Figure 2 Decision Points for the Treatment of 
Decompression Sickness 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


fl PROPOSED APPROACHES 

o Optimize the duration of hyperbaric treatment 

- Reasons 

9 Utilize all information available 

- Types of data available 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


B SUMMARY 

9 Derived design goals of Hyperbaric Treatment 
9 Traditional treatment protocols 
9 Instrumentation already available 
9 Hundreds of hyperbaric chambers could benefit 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


B SUMMARY (Continued) 

• (Opening question for Panel discussion) 

Is it possible to use Fuzzy Logic and the additional information 
available to accurately determine the required duration of 
hyperbaric treatment? 

- The additional information is : 

1) . Instrument Data: hyperbaric chamber pressures, pressure rate 
of change, and the exhaled breath gas compositions 

2) . The objective data from the examining attendant: patient's vital 
signs 

3) . The subjective data: from the patient's responses to the 
questions of the attendant 

4) . The exposure data: duration and pressure of exposure 
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(Continued) 


B SUPPLEMENTAL INFORMATION 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


B OUTLINE 

® Introduction 

• Problem Formulation 

• Proposed Approaches 
e Summary 

9 Panel Discussion 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


INTRODUCTION 


© Hyperbaric Treatment is the medical protocol used to treat 
Decompression Sickness. 

© Decompression Sickness can result from exposure to a significant 
reduction in ambient pressure. 

e Space Station crewmembers risk decompression sickness when 
they perform an extra-vehicular activity (working outside the 
Space Station). Another risk is the unexpected decompression of 
a Space Station module. 

e Decompression sickness is characterized by inert gases in the 
body coming out of solution and forming gas bubbles in the body 
tissues. 

© The most common form of decompression sickness is the bends. 
Severe cases can be fatal. 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 

H INTRODUCTION (Continued) 

e The only definitive treatment for decompression sickness is 
hyperbaric treatment - treating the patient with pressure and 
oxygen for sustained periods of time. 

- A common hyperbaric therapy protocol is shown in Figure 1. 
This table and others were developed by the Navy, essentially by 
trial and error. 

© Hyperbaric treatments for Space Station will range from 2 Hours to 
a maximum of 67 Hours at pressures as high as 2.8 atmospheres. 

© Hyperbaric treatment requires 3 persons, in addition to the person 
being treated. This involves the entire Space Station crew. 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


PROBLEM FORMULATION 

9 There are no quantitative measurements which can be monitored 
to accurately determine the required duration of hyperbaric 
treatment. 

e Figure 2 shows decision points that terrestrial observers use to 
determine the duration of hyperbaric treatment. 

- The decision points are boolean. No provisions are made for 
partial relief of symptoms. 

9 Examination of the relationship between the amount of inert gases 
in the exhaled breath and the amount of inert gases remaining in 
the body. 

- Not a deterministic relationship. Other data needed. 

o A form of mass spectrometer can determine the inert gasses in the 
exhaled breath. 

- This equipment will be available on Space Station. 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 

m PROBLEM FORMULATION (Continued) 

© Unique circumstances onboard Space Station 

- Minimal crew of 4 

- Far away from help 

- No Medical Doctor 

- Limited amount of resources 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 

rn PROPOSED APPROACHES - DESIGN GOALS 
e Optimize duration of Hyperbaric Treatment to: 

- Get medical treatment to a crewmember in hyperbaric treatment. 

- Return injured crewmember to earth as soon as possible. 

- Alleviate other crewmembers from hyperbaric duties to perform 
critical activities. 

- Conservation of Resources. 

e Utilize all available information in determination of ideal duration of 
treatment. 

- Objective instrument data 

- Objective medical attendant data 

- Subjective data from patient's responses 

- Exposure data 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


SI SUMMARY 

o Derived design goais of Hyperbaric Treatment of decompression 
sickness 

- Reduce delays in treating other injuries 

- Return patient to earth as soon as possible 

- Free up other crewmembers for critical activities 

- Conserve vital resources 

o Traditional treatment protocols do not optimize the design goals 

- Boolean decisions based on primarily subjective inputs 

• The instrumentation to provide objective inputs will be available on 
Space Station. 

9 Hundreds of hyperbaric chambers in terrestrial use could benefit 
from an accurate determination of required hyperbaric treatment. 
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HYPERBARIC TREATMENT 

by 

Michael T. Amoroso 
(Continued) 


M SUMMARY (Continued) 

e (Opening question for Panel discussion) 

Is it possible to use Fuzzy Logic and the additional information 
available to accurately determine the required duration of 
Hyperbaric Treatment? 

- The additional information is : 

1) . Instrument data: hyperbaric chamber pressures, pressure rate 
of change, and the exhaled breath gas compositions. 

2) . The objective data from the examining attendant: patient's vital 
signs. 

3) . The subjective data: from the patient's responses to the 
questions of the attendant. 

4) . The exposure data: duration and pressure of exposure. 
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Topic: 

Presenter: 

Comment: 


Q (Brown): 
A: 


Q (Lawler): 
A (Spoor): 

Comment: 

Q (Aldridge): 
A (Spoor): 

Q (Lawler): 
A (Spoor): 

Q (Lawler): 
A (Spoor): 

Comment: 

Q (Stegall): 
A: 

Comment: 


Hyperbaric Treatment Control 
Mike Amoroso 

(Amoroso) Every time astronauts do EVA, they risk decompression 
sickness. With decompression sickness, pressure and oxygen treatment 
must be in precise control. Three people are required to perform hyperbaric 
treatment - timekeeper, chamber controller and an astronaut is needed to 
control the pressure. They monitor three variables - oxygen, pressure, and 
time. 

Is there a correlation between past treatments and additional data? (refer to 
the summary on page 7 of presentation) 

- Exhaled breath can be used, but more information is needed. 

- Duration of exposure and time of overall treatment is not currently being 
looked at by anyone. 

- No data to clarify change to treatment tables; they were developed through 
trial and error. SCUBA diving incidents make up the most cases of the 
bends. 

- Active modelling is not being performed. 

- No bends on Space Activity. It is estimated that there is a 2-3% treatable 
bends risk per EVA. 

What about data from the Russians? 

The Russians say they have no problems. There has been one instance of 
joint pains which may or may not be attributable to the bends (both die U.S. 
and Russia have reported this). 

(Spoor) When dealing with human sickness, you often get "fuzzy" answers 
(subjective information). For example, trying to detect the extent of 
numbness, how "weak” is an arm, "are you ’ok'?“. The inputs to the 
decision maker are not distinct values. 

Has there been treatment based on anything other than the hyperbaric 
chamber? 

It's possible to bring the Shuttle cabin down as low as is feasible; pump up 
space suit as high as possible (1.3 - 1.5 atmosphere). 

Will Life Sciences "buy off’ on this application? 

They see the potential. 

Have you talked with the CHeCS people (on the NASA side) 

Yes, we have been talking to Dr. Norfleet (Crew Hyperbaric). 

Value added of using fuzzy logic application — > elimination of using an 
extra crew member for treatment. 

Is there some way to implement the application as an advisory position? 
Absolutely. The ultimate (medical) decision is with the doctor (on the 
ground). 

(McRobeits) There are three tests: 

(1) How does the patient feel? 

(2) Schedule of decompression 

(3) Executing - sequential 
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D OUTLINE 

® Introduction 
• Problem Description 
9 Proposed Approaches 
9 Summary 
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DAILY EXERCISE ROUTINES 

by 

Patrick L. Anderson and Michael T. Amoroso 

(Continued) 


H INTRODUCTION 

® Daily exercise and periodic stress testings are required on Space 
Station. 

— Exercise Equipment: Treadmill, Dual Bike, Muscular Output Trainer, 
and portable exercise equipment. 

- Physiological Monitors: Daily - ^ i -a a | |. | 1 *1 

Blood Pressure Monitor, Electrocardiograph, Metabolic Gas Monitor, 
and Body Mass Measurement Device. 

• The equipment is configured either automatically or manually. 

e Data is obtained from the physiological monitors and logged by 
the system. 

• Exercise physiologist monitors data and updates the protocols. 
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DAILY EXERCISE ROUTINES 

by 

Patrick L. Anderson and Michael T. Amoroso 

(Continued) 


B3 PROBLEM FORMULATION 

e Exercise protocols strive to maintain cardio-vascular, and 

musculo-skeletal systems at levels established by doctors and/or 
exercise physiologists. 

e To provide consistent data during stress testing, it is desirable to 
maintain physiological levels without exceeding targets. 



e Metabolic Gas Monitor data, exercise workload data, and 
perceived exertion levels from interviews (subjective data) are 
used to ascertain the physical condition of crew members to 
determine modifications to protocols. 
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DAILY EXERCISE ROUTINES 

by 

Patrick L. Anderson and Michael T. Amoroso 

(Continued) 


m PROPOSED APPROACHES 

o Daily exercise data and periodic stress test data is collected 
on-orbit and sent to the ground. 

e Exercise protocols are modified based on the analysis of data by 
an exercise physiologist. 


Nomograms 
Experience 
Desired Response 
(Analysis of Data) 



New/Modified 

Exercise 

Protocol 

(Update) 



Crewman 

Executes 

Protocol 

(Use) 



Nature of Exercise 
Oxygen Uptake 
Environment 
(Data Collection) 


© New exercise protocols are uploaded. 

© Crew member executes new protocol. 

© During stress testing, step function feedback to exercise 

equipment is provided to reduce overshoot of target physiological 

parameters. 
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DAILY EXERCISE ROUTINES 

by 

Patrick L. Anderson and Michael T. Amoroso 

(Continued) 


m SUMMARY 

• Analysis of exercise data is performed by an expert and utilizes 
subjective input. 

• Equipment control is provided by step functions using time and 
magnitude as input parameters. 


• (Opening question for Panel discussion) 

Is Fuzzy Logic a viable alternative to the current approach? 
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Topic: Daily Exercise Protocol 

Presenter Pat Anderson 

Comment: (Berenji) Wherever there is a control problem that experts can define 

heuristics for the fuzzy rules, it makes sense to model the process using 
rules and fuzzy logic. 

Comment: (Weiss) There is lots of literature available. If you treat system where 

output is heartrate, you can control heartrate by workload (i.e. adjust bungi 
cords so that the optimum heart-rate is achieved). 
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e Problem Formulation 

• Proposed Approaches 
e Summary 

• Panel Discussion 
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ATMOSPHERIC CONTROL SYSTEMS 


by 

Melanie Mankamyer 
(Continued) 


m INTRODUCTION 

e The Space Station (and future manned space missions) require 
atmospheric control systems 

® Spacecraft atmosphere control systems consist of: 

- Temperature control 

- Composition control 

- Pressure control 

e Composition control includes controlling the major constituents, 
humidity, and trace contaminants 

0 Temperature, pressure, and composition control are all 
interrelated 
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ATMOSPHERIC CONTROL SYSTEMS 

by Melanie Mankamyer (Continued) 


m PROBLEM FORMULATION 

o Cabin temperature is selectable between 64.4 °F - 80.6 °F and must 
be maintained within 1 °F 

• Cabin atmospheric pressure is set at 14.7 psia and maintained 
within 0.2 psi 

e Oxygen partial pressure is set at 2 psia 

• Relative humidity is maintained between 25% and 70% (dew point 
temperature is always maintained above 59 °F) 
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ATMOSPHERIC CONTROL SYSTEMS 

by Melanie Mankamyer (Continued) 

H PROPOSED APPROACHES 


o The classical approach to temperature control is to use a heat 
exchanger with flow bypass. 

o A liquid side bypass system is smaller but slower to respond 


COOLANT 
LOOP 




Bypass flow 


5HEAT EXCHANGE#! 


AIR LOOP 




1 


Bypass Control Valve 

Feedback 

Constant exit 
air temperature 


• The air side bypass system provides a quicker response and can 
also maintain humidity with the use of a condensing heat 
exchanger 


Bypass 

Control 

Valve 



AIR LOOP 

Constant exit 
air temperature 
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ATMOSPHERIC CONTROL SYSTEMS 

by Melanie Mankamyer (Continued) 

m PROPOSED APPROACHES (cont.) 

• Major atmospheric constituent control is coupled with pressure 
control and Is accomplished with a 2-gas controller 

- Sensor registers a drop In total cabin pressure of 0.2 psl 

- Controller checks the partial pressure of oxygen (sensor) 

- If oxygen level low, a valve is opened and oxygen added until the 

partial pressure is met, then nitrogen is added until total 
pressure is met 

- If oxygen level is good, then a valve is opened and nitrogen is 

added until total pressure is met 



11 / 9 / 90 ^^*^^ Station Freedom McDonnell Douglas • QE • Honeywell • IBM • Lockheed 





ATMOSPHERIC CONTROL SYSTEMS 

by Meianie Mankamyer (Continued) 


m SUMMARY 

© Techniques to maintain atmospheric control parameters have been 
identified 

© Fuzzy Logic Control Law has been mentioned for application to 
atmospheric control 

© (Opening question for Panel discussion) 

What advantages does fuzzy control logic offer to the rather 
simplistic controls of the atmospheric control systems? 
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Q (Brown): 
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Comment: 

Comment: 


Atmospheric Control 
Melanie Mankarnycr 

(Mankamyer) Space Station is not using automatic oxygen control due to 
scrub activities. Astronaut must manually check gauges and manually 
adjust the levels as needed. No active monitoring in die contamination 
system. 

(Lea) Better cost and temperature control with fuzzy logic usage. Such a 
system keeps responding to the various changes (temerature, etc). 

( Mankamy er) Systems are mainly worked in WP-01. Temperature control 
is in nodes/airlock. 

How much oxygen can you go without before you can detect the loss of 
oxygen (referring to faulty gas control). 

You can detect sutle symptoms; a person can possibly go to 14,000 - 
14,500 feet, after that you need oxygen compensation. 

What if there is a valve problem? 

Carbon Dioxide sensors are part of ECLSS (caution & warning system) 

(Berenji) Cooperating expert systems is a strong possibility (Thermal, 
power, etc). 

(Brown) Due to scrub activities, the type of work Dr. Berenji mentioned 
would not be possible (no automated power). 
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ROTATIONAL SPEED CONTROL 


B BACKGROUND 


* A life sciences centrifuge is scheduled to fly aboard Space 
Station 

o Live animal and plant specimens will be carried on the rotor 
and compared with microgravity specimens in racks 


• The centrifuge provides both a one-g control environment and 
£ variable gravity capability 

e Experimenters indicate that specimens are sensitive at the milli 
g level under microgravity conditions 


• Centrifuge gravity level (speed) variation must be minimized 


e Acute studies involving constant angular acceleration spin-up 
and spin-down profiles are also desired for neurovestibular 
research 
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Habitat and major subsystem accommodations on rotor: 
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ROTATIONAL SPEED CONTROL 


m REQUIREMENTS 

© The life sciences centrifuge holds specimens at variable 
gravity levels between 0.01 g and 2.0 g (approximately 2.8 to 
40.0 RPM) 

© Steady-state gravity level to be maintained constant to within 
7.07 x 10-4 g RMS or 2%, whichever is greater 

© Maximum specimen radial jerk ("g-dot") of 0.01 g/sec during 
spin-up, spin-down, and changes in acceleration 

e Repeatability of gravity levels to within 1% 

© Specimen extractor rotor to provide angular rates up to 30 
deg/sec2 with rates selectable in increments of 1 deg/sec2 or 
less 
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ROTATIONAL SPEED CONTROL 


H APPLICATION AND TYPICAL SOLUTION 
© Centrifuge rotor speed control 
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ROTATIONAL SPEED CONTROL 


H SUMMARY 

e Key requirements for a case example involving rotor speed 
control have been identified 

e (Opening questions for Panel discussion) 

How can fuzzy logic control be applied to rotational speed 
control systems to meet desired performance requirements 
at a lower cost or complexity than conventional methods? 

What are typical tolerances that can be held using fuzzy logic? 
Does the particular example discussed have high suitability for 
the fuzzy logic control approach? 
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Q (Lawler): 
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Q (Lawler): 
A: 


Rotational Speed Control 
PaulBasdn 

(Basdn) System is continuously running - requirement for up to 90 days 
operation. 

(Berenji) Fuzzy logic is able to handle imprecisions and preconditions in the 
rules appear to have more slack. Overall, fuzzy logic system is more robust 
and has better adaptation with weight changes. 

(Brown) The Japanese use Fuzzy logic control in applications such as in the 
subway trains in order to smooth the starting and stopping of the trains. 
The goal of this application is similar in terms of the goal of smoothness of 
operation; fuzzy logic can handle the large variations. 

How much "change" in die system? 

Not alot - 5 % to 10% 

How much evolution in terms of the size of experiments are being allowed 
for? 

The system is able to accomodate new experiments and the current design 
allows for the size of the envelopes to be modified and heavier loads. 


Comment: 


(Jani) The acceleration should be measured by accelerometers. 
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VIBRATION ISOLATION 


■ INTRODUCTION 

• Many subsystems, payloads, and events on Space Station are 
potential disturbance sources in the microgravity environment. 
Examples include 

- Exercise equipment - treadmill 

- Rotating equipment - centrifuge 

- Planned events - berthing and docking 

- Unplanned events - crew motion 

© Isolation may be required both to attenuate vibration from 
"noisy" subsystems as well as to protect sensitive payloads 

@ Low frequency disturbance sources are an important concern 
due to sensitivity of Space Station flexible structure modes 
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MICROGRAVITY ASSESSMENT CRITERIA 


• For continuous periods of at least 30 days and 50% of the operational 
year, the following criteria applies: 

— No greater than 1 micro-g steady-state acceleration levels In the rack 
volume of the U.S. Laboratory 

— Torque Equilibrium Attitude +/- 5 degrees of Local Vertical Local 
Horizontal (LVLH) 

— Induced Vibration acceleration levels: 


^ 1x10-6 g for f < 0.1 Hz 

_2- 


^ (1x10-5 x 0 Q for 0.1^ f ^ 100 Hz 
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VIBRATION ISOLATION 

S PROPOSED APPLICATION 
® Life Sciences Centrifuge 

- Provide variable gravity centrifugation from 0.01 to 2 g for 
specimens (maximum 40 RPM [0.7 Hz] rotation rate) 

- Rotating mass approximately 2200 lb 

- 2.5 meter diameter 

- Mounted in Space Station Node endcone 

- Independent extraction rotor spins up and down to remove a 
pair of specimen habitats from rotating main rotor 

- Disturbance to Space Station limited to 25% of microgravity 
requirement 

- Disturbance to specimens limited to 1 x 10-3 g in frequency 
range 0.1 to 100 Hz 
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ADDITIONAL DESIGN DETAILS 
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ISOLATION 


m TYPICAL SOLUTIONS 

© Active vibration isolation system 
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VIBRATION ISOLATION 


m TYPICAL SOLUTIONS (continued) 
» Active balancing system 
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VIBRATION ISOLATION 


m SUMMARY 

© Techniques to control and isolate centrifuge disturbances have 
been identified 

© (Opening questions for Panel discussion) 

How can fuzz y logic be applied to Space Station vibration 
isolation systems to improve performance over passive 
approaches or reduce the cost and complexity of active 
approaches? 

Could fuzzy logic control be used to facilitate an inexpensive 
active low frequency isolator? Could a simple active controller 
be implemented to augment a conventional passive isolator? 

Can fuzzy logic control be used to improve signal to noise ratio 
or response time? 
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Vibration Isolation 
PaulBasdn 

(Knacks tedt) The problem of vibration isolation may have more stringent 
requirements than those of Rotational Speed Control. 

(Brown) The conflicting requirements mentioned have no effect on the fact 
that there is a serious problem of isolation of vibrations. The question of 
whether Fuzzy logic can be used to build an active isolator or to design a 
passive isolator to improve performance over cost should be considered. 

(Berenji) The experiments on board need a steady, vibration-free platform. 
These systems must be stable, fuzzy logic is applicable. Is this problem to 
different from those of which fuzzy logic can be used? 

(Jani) Fuzzy logic should not be too difficult in implementing a solution to 
this problem. 

(?) The "fuzzy" control surfaces shown in Dr. Kosko’s examples were 
"pipe organ-ish" showing discontinuity. With Vibration Isolation problem, 
there is a great concern for smoothing the operation. 

(Berenji) Agreed with comment that a non-smooth transition can create 
problems. However, the examples shown were not necessarily optimal 
(which is problem dependent); multiple fuzzy rules can create a smoothing 
operation 
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SUMMARY - Bob Brwo 


The objectives of this workshop were to demonstrate that (1) Fuzzy Logic is a mature 
technology, (2) to prove that it was well founded in basic mathematical principles, (3) to 
show that the experts in the field were knowledgeable control systems engineers and 
scientists, (4) to demonstrate that fuzzy logic could solve non-linear problems and (4) that 
this technology was target to complex applications. In addition, we wanted to show-case 
potential applications to our customers (NASA). In so doing, we sought to present a wide 
spectrum of applications that could potentially result in two funded projects. 

Dave Wcnsley set the tone of the workshop and McDonnell Douglas's commitment to 
advanced automation. 

Mark Gersh, NASA Headquarters, stated NASA’s position and plans in his area of 
responsibility (Space Station Advanced Automation) and what NASA was looking for in 
the way of future projects. 

Dr. Togai gave an excellent presentation on the wide ranging commercial applications 
which demonstrated the maturity of fuzzy controls. 

Professor Sugeno discussed his projects in the development of autonomous flight 
control for helicopters. Professor Sugeno, a control systems theorist, is funded by the 
Japanese government to develop and demonstrate this capability. During the workshop 
Prof. Sugeno suggested that he would like to join McDonnell Douglas in a complex 
application of fuzzy logic on the Space Station Program. Prof. Sugeno's project caught die 
attention of the audience because of the complexity of the problem and his extreme 
confidence that he would succeed. 

Dr. Aldridge did an excellent job in preparing the workshop for the transition from 
traditional control theory to fuzzy control. His example of die inverted pendulum gave the 
audience a good demonstration of the basic concepts and how to apply them to a control 
problem. 

Dr. Berenji offered several alternatives for providing training to McDonnell Douglas 
personnel. Once the projects are selected.we will discuss the specifics with the Ames 
Research Center as part of our Technical Exchange Agreement 

Dr. Bart Kosko did an excellent job in the mathematical derivation of Fuzzy Estimation 
Theory. Many of the skeptics have had to rethink their objections to Fuzzy Logic as a 
result of Dr. Kosko's work. Dr. Kosko gave the workshop the equivalent of a 6 hour 
lecture in 90 minutes. 

The panel was impressed with the wide ranging applications presented by the speakers. 
Their conclusion was that all presentations were good cauMaics for Fuzzy Control. 


446 


Mark Gcrsh, in his summary, said he plans to return to Washington to tell the Space 
Station Program management that this technology is mature and that they should fund an 
effort 

The selection of the candidates will be based on how well they meet NASA and 
McDonnell Douglas' criteria. 

All the comments I have received indicate that this was a very successful workshop and 
accomplished all of our objectives. NASA liked the format and plans to use it in future 
workshops. 
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CONCLUDING REMARKS - Mark Gersh 


The NASA Headquarters Autonomous Systems Manager for Space Station 
Engineering, Mark Gersb, made some concluding remarks which expressed his 
impressions of the workshop. Overall, Mr. Gersh noted that he was "very impressed with 
the knowledge and expertise" attending the workshop. He stated that there were scores of 
potential applications for Fuzzy Logic control on the Space Station Freedom Program 
(SSFP). In addition, Mr Gersh said he would take back the message that this was a mature 
technology ready for application and would recommend that funds be set aside to fund two 
projects. 

Mr. Gersh gave some guidelines and comments for pursuing these projects. They 
included: 

1 . Due to the high degree of maturity of Fuzzy Logic Control technology, it 
should be considered for use in SSFP. 

2. This technology is grounded in theory and science. 

3. We need to find candidate programs to showcase the benefits of this 
technology. 

4. Considering the needs of SSFP, we should investigate how Fuzzy Logic 
Control technology can help us reduce power usage and weight constraints. 

5 . We need to utilize this technology to help the SSFP meet it’s requirements of 
limited computational environment. 

6. The technology should be used to help maximize the SSFP's usage of crew 
time. 

7 . In logistics, such as fuel re-supply, Fuzzy Logic should help reduce the need 
due to it's optimization qualities. 

8 . In development of a project we need to consider how well the baseline issue is 
handled. 

9. Any Fuzzy Logic project in SSFP should entail user participation. 

10. The project should influence the baseline program. 

1 1 . The early demonstration of Fuzzy Logic technology should be provided for in 
any funded project 

12. The application should be simplistic enough to solve yet complex enough to 
show the importance of the problem. 

13. There should be measurable success in terms of solving a baseline problem 
and benchmarking against conventional control techniques. 
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In conclusion, Mark Gersh thought that this technology should be showcased and that 
he would propose the support of 2 projects on SSFP to be selected based on NASA's 
criteria. 
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Concluding Remarks - Hamid Berenji 


This workshop brought together a number of distinguished researchers in the field of 
fuzzy logic and also a number of fuzzy logic control application specialists. Although 
NASA has taken the lead in the U.S. by sponsoring two previous conferences on Fuzzy 
Logic and Neural Network applications at the Johnson Space Center (1988 and 1990), the 
current workshop held at McDonnell Douglas was clearly a major step forward in further 
exposing this technology to a number of engineers and scientists involved in control of 
major subsystems of the Space Station. The systems presented at this workshop were 
unique in many respects and pose serious challenges to us in the design and development 
of controllers for their actual deployment in space. The panel members and the other 
workshop at ten d an ts developed significant understandings of the requirements which have 
to be met by these control systems. In almost all the systems presented, panel identified 
and foresaw areas for application of the fuzzy logic control technology. These 
observations were encouraged in part by discussing the s imilari ties between the subsystems 
presented and those already very successful commercial applications of the fuzzy logic 
control. 

I believe that this workshop was very successful in many respects. Although the field 
of fuzzy logic control requires further research in some areas, it has already matured 
enough to be applied in many real life control problems. A follow up workshop, including 
reports of actual experiences in applying this technology to some of the subsystems of the 
Space Station, is recommended. 

Finally, I would like to acknowledge the excellent works of Mr. Bob Brown and others 
in organizing tins workshop. Also, many thanks to the members of my panel who had to 
travel long distances (e.g.. Professor Sugeno who came from Japan) to be at this 
workshop. 


Hamid R. Berenji 
November 1990 
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